Photographing apparatus and photographing method

ABSTRACT

Disclosed is a photographing apparatus of interlace transferring type comprising:  
     a photographing device which carries out transfer of electrification of all pixels stored in the photographing device by dividing into a plurality of fields when transferring the electrification and which has a plurality of color filters and which includes a color signal of at least RGB or YeCyMgG in said transfer data of each field for transferring said electrification; extraction means for extracting characteristic data of image from transferred data before processing for image is started;  
     generating means for generating control value carrying out correction of image based on said extracted characteristic data; and  
     photographing processing means for processing image by use of control value formed by said characteristic data.

BACKGROUND OF THE INVENTION

[0001] 1. Field of the Invention

[0002] The present invention relates to a photographing apparatus suchas a digital still camera and a photographing method using aphotographing device in an interlacing transfer system where upontransferring electric charges stored in a photographing device the totalpixels are divided into a plurality of fields, and a color signalcomprising at least RGB or YeCyMgG is involved in transfer data in eachfield.

[0003] Incidentally, the present invention further relates to adynamical defect involved in a digital still camera constructed with asolid pick-up device such as a CCD and furthermore relates to an imageinformation processing apparatus.

[0004] 2. Description of the Prior Art

[0005] In a digital still camera where CCDs are employed as pick-updevices, a cell constituting each pixel of the CCD generates electriccharges in response to the rate of received light. The amount ofelectric charges in each cell are read out as the value of pixels, whichvalue of pixels is outputted subsequently from the CCD as image data fora photograph per 1 frame.

[0006] In a photographing apparatus used for a prior art digital camera,there are known transfer of electric charges from a photographing devicein conformity with an interlacing system where reading is performedtwice or a progressive system where readout is performed once.

[0007] These systems have merits and demerits. For example, a digitalcamera disclosed in Japanese Laid-Open Patent Publication No.2001-285688 operates in both systems of interlace transfer andprogressive transfer. The interlacing transfer system in the abovedisclosure provides a high quality image by making use of a single shotmode with a shatter although long processing time is required, while theprogressive transfer system ensures high speed by making use of acontinuous photographing mode where a signal of a one pixel train istransferred to a plurality of pixel trains without the use of a shutter,although smear might happen.

[0008] Further, in accordance with a video camera, a measurement oflight, and a detection method for focusing disclosed in JapaneseLaid-Open Patent Publication No. Hei 6-54250, preliminary photographingis performed to adjust the rate of exposure to light by making use ofthe divided one field in an interlace transfer system, and then toadjust a focused position.

[0009] However, in a photographing apparatus using pick-up devices in aninterlacing transfer system with such a construction, upon electriccharges stored in a pick-up device being transferred, the signal isclassified into R, Gr signals and B, Gb signals in the case of colorfilters in a primary color system or into Ye, Cy signals and Mg, Gsignals in the case of color filters in a complementary color system,which are transferred in two fields of first and second fields asillustrated in FIG. 7. In this transfer system, data required for animage processing for the RGB signal or the YeCyMgG signal can not beobtained until the transfer of the two field fractions of the first andsecond fields to result in much time for the image processing. Further,even in preparations of an image for checking photographing and of athumbnail image similar processing are performed while requiring sometime.

[0010] In general, a CCD for use in a photographing apparatus includesas illustrated in FIG. 38 a pixel S arranged in a matrix, a verticaltransfer register VR provided for each vertical line along a horizontalone side of each pixel S, and a horizontal transfer register HR providedon the side of a final end of each vertical transfer register VR. Inthis CCD, any one among three primary filters of R (red), G (green), andB (blue) is disposed on each pixel S. The pixel S on which the R filteris disposed converts the light of R and outputs an R signal, and a pixelS on which a G filter is disposed converts the light of B and outputs aG signal, and a pixel S on which a B filter is disposed converts thelight of B and outputs a B signal.

[0011] In the foregoing three primary color filters, regions from whichthe respective signals are outputted are arranged horizontally in theorder of R,G,R,G . . . or G,B,G,B, and a horizontal line (hereinafterreferred to as an RG line)of the arrangement of the color filters ofR,G,R,G . . . and a horizontal line (hereinafter referred to as a GBline) of the arrangement of the color filters of G,B,G,B . . . arealternately provided. It is noticed that in order to discriminate the Gsignal from the RG line and the G signal from the GB line the G signalfrom the RG line is described as a Gr signal and the G signal from theGB line as a Gb signal in the figure.

[0012] In the prior art interlacing transfer method, upon transferringelectric charges stored in the CCD constructed as described above theregions are divided into the field constructed from the GB line (referto FIG. 4(a).) and the field constructed from the RG line (refer to FIG.4(b).) for transfer with two fields.

[0013] In the prior art transfer system, however, the field constructedfrom the GB line contains only the Gb signal and the B signal, while thefield constructed from the RG line contains only the R signal and the Grsignal. More specifically, since all kinds of RGB signals aretransferred only after the transfer of the two fields is finished, datarequired for the image processing of ROB cannot be obtained until thetransfer of all fields is finished.

[0014] It is accordingly impossible to prepare image characteristic datain the whole of an image up to the completion of the transfer of theimage, and hence it is impossible to start image processing thereafter.There is therefore problems that much time is required until the imageprocessing is completed and too much time is required until the nextphotographing since the photographing.

[0015] Further, in such a digital camera which employs a CCD as aphotographing device a cell of the CCD constructing each pixel generateselectric charges in response to the quantity of received light. Thequantity of the electric charges in each cell is read as the value ofpixels, which value is in turn outputted in succession from the CCD asimage data for a photographic image of 1 frame. The digital still camerais improved in its miniaturization and in high resolution. This howevercauses a severe problem of a pixel defect occurring on part of each cellconstructing a pixel as the number of such pixels is increased.

[0016] The pixel defect of this kind includes defects called a whitedefect, a white defect, an in-bright white defect, and a temperaturewhite defect. The black defect originates from dust and the likedeposited on a light incident surface of a pixel, and the in-brightwhite defect originates a defect on a color filter or a micro-lensdisposed on the light incident surface.

[0017] Any of these black defect and in-bright white defect is a staticdefect happening irrespective of an operation temperature environment ofa CCD, which is being improved as a technique of the manufacture of asemiconductor for use in the manufacturing process of a CCD.

[0018] In contrast, the temperature white defect is also called a darkcurrent defect, which is a dynamical one influenced by a change in adark current and accumulation of electric charges, i.e., a change in thetemperature of a CCD and a change in exposure time to light.

[0019] For correcting the temperature white defect being a dynamicaldefect, Japanese Laid-Open Patent Publication No. 2000-10192 or No.2000-224487 proposes a technique wherein an address of a pixel where thetemperature white defect of a CCD occurs is previously stored in amemory, and the value of a defective pixel is corrected on the basis ofan address stored in the memory upon photographing with a digital stillcamera.

[0020] However, the temperature white defect changes owing totemperature and exposure time to light, so that for obtaining theaddress of a pixel on which the temperature white defect occurs it isnecessary to take temperature and exposure time to light as parameters,and investigate on which pixel a temperature white defect of a levelcausing a problem under the conditions of those parameters, and preparean address table thereof.

[0021] Such an investigation is required for every combination of theparameters, so that much labor is required for the preparation of anaddress table for the defective pixels, and hence it is not practical.Further, even if all address data about the temperature white defect canbe prepared with a linear interpolation method from part of addressdata, there are required a temperature sensor for measuring operationtemperature being one of the parameters and a memory for storing anaddress table in which addresses of defective pixels are listed. Thiscauses a difficulty that the cost of the camera is increased.

[0022] A photographing apparatus is known as an electronic still camerain which electric charges of all pixels accumulated in response to animage focused with imaging means are transferred to a photographingdevice equipped with color filters for color decomposition, andpredetermined image processing is executed to form an image, and whichis being assembled as part of functions of a portable informationterminal such as a cellular phone and a computer apparatus.

[0023] Further, for the photographing apparatus, there is beinggeneralized “a photographing device in an interlacing transfer system inwhich upon electric charges of all stored pixels being transferred datatransfer of the electric charges is executed, divided into a pluralityof fields” to deal with an increase of the number of pixels and arequirement of making the device compact.

[0024] For example, when in a color electronic still camera for use in aphotographic device in such an interlacing transfer system color filtersfor color decomposition are of a primary color system of red (R), green(G), and blue (B), information involved in one field is red (R)•green(G) information or blue (B)•green (G) information, and hence necessaryinformation for preparing a color image is not obtained only with theone field.

[0025] In prior art, in such an electronic still camera there is aproblem that until the transfer of all fields is finished, in otherwords until transfer of all electric charges accumulated on aphotographic device is finished, no image processing is executed, forexample “the time required for displaying a conformation image ofphotographing” is increased.

[0026] Further, in the aforementioned electronic still camerainformation of all electric charges is an object of the imageprocessing, so that the image processing time requires a predeterminedtime irrespective of set resolution and a compression rate, which causesa problem of “inconvenience” where even when an object originallyrequiring less image information such as “images for low resolution andfor high compression rate”, much time is required until the nextphotographing is enabled.

[0027] It is, therefore, an object of the present invention to provide aphotographing device and a photographing method capable of solving theaforementioned problems.

[0028] To accomplish the above object, according to the presentinvention a photographing apparatus of interlace transferring type isprovided. In one embodiment, it comprises:

[0029] a photographing device which carries out transfer ofelectrification of all pixels stored in the photographing device bydividing into a plurality of fields when transferring theelectrification and which has a plurality of color filters and whichincludes a color signal of at least RGB or YeCyMgG in said transfer dataof each field for transferring said electrification; extraction meansfor extracting characteristic data of image from transferred data beforeprocessing for image is started;

[0030] generating means for generating control value carrying outcorrection of image based on said extracted characteristic data; and

[0031] photographing processing means for processing image by use ofcontrol value formed by said characteristic data.

[0032] In the other embodiment, a photographing apparatus of interlacetransferring type comprises:

[0033] a photographing device which carries out transfer ofelectrification of all pixels stored in the photographing device bydividing into a plurality of fields when transferring theelectrification and which has a plurality of color filters and whichincludes a color signal of at least RGB or YeCyMgG in said transfer dataof each field for transferring said electrification;

[0034] extraction means for extracting characteristic data of image fromtransferred data before processing for image is started; generatingmeans for generating control value carrying out correction of imagebased on said extracted characteristic data;

[0035] photographing processing means for processing image by use ofcontrol value formed by said characteristic data; and

[0036] selection means for selecting either a first mode for processingand recording the transfer data of all pixels accumulated in saidphotographing device or a second mode for processing and recordingtransfer data of pixels less than said all pixels, wherein in saidsecond mode selected by said selection means, later transferred data isprocessed and recorded by the control value generated by saidcharacteristic data extracted from the previously transferred data withdivision of the plurality of fields.

[0037] The color filter provided in the photographing device is composedof original color of RGB.

[0038] The color filter provided in the photographing device is composedof complementary color of YeCyMgG.

[0039] The apparatus has an interlace (or interlacing) transfer in whichtransfers of 3 times carried out by dividing the plurality of fields areachieved and each field is thinned perpendicularly into ⅓.

[0040] The characteristic data of image is color distribution forcontrol of white balance and control value for white balance isgenerated based on said characteristic. The characteristic data of imageis also data in which edge component within a screen is extracted and acontrol value for enhancing the edge is generated based on thecharacteristic data. The characteristic data of image is data in which acolor information within a screen is extracted and a control value ofcolor converting coefficient is generated based on said characteristicdata. The characteristic data of image is data in which distribution ofbrightness within a screen is extracted and a control value of contrastcorrection is generated based on said characteristic data.

[0041] The photographing apparatus generates processes image ofdigitalization and said characteristic data of image is data in whichdistribution of brightness within a screen is extracted and threshold ofdigitalized processing based on said characteristic data is generated asa control value.

[0042] According to the present invention, an photographing method ofinterlace transferring type is provided. The method comprises the stepsof:

[0043] dividing data transfer of electrification of all pixels stored inan photographing device of interlace transferring type into a pluralityof fields when transferring the electrification; providing a pluralityof color filters in said photographing device; receiving transfer datafrom said image element which transfers data including a color signal ofat least RGB or YeCyMgG to each field; extracting characteristic data ofimage from the transferred data; and generating a control value ofeffecting correction of image based on the extracted characteristic datato make image processing using said control value.

[0044] The present invention provides an photographing method ofinterlace transferring type comprising the steps of:

[0045] dividing data transfer of electrification of all pixels stored inan photographing device of interlace transferring type into a pluralityof fields when transferring the electrification; providing a pluralityof color filters in said photographing device;

[0046] receiving transfer data from said image element which transfersdata including a color signal of at least RGB or YeCyMgG to each field;

[0047] extracting characteristic data of image from the transferreddata;

[0048] generating a control value of effecting correction of image basedon the extracted characteristic data to make image processing using saidcontrol value; and

[0049] processing and recording later transferred data by the controlvalue generated by said characteristic data extracted from thepreviously transferred data with the division in the plurality offields.

[0050] Transfers of 3 times of electrification are carried out bydividing into the plurality of fields and thinning perpendicularly eachfield into ⅓.

[0051] The photographing apparatus includes a solid photographing devicewhich has a plurality of pixels compartmentalized in every predeterminedregions and in which a pixel for detecting a pixel value of each colorof three original colors through a color filter of said plurality ofpixels is arranged in said regions. The photographing device isdetermined so that a defecting pixel for generating a white scratch oftemperature which changes according to temperature is one or less ineach region, each pixel value of all the pixels in the solidphotographing device being read out with division of fields of three ormore to form an image of one frame based on the read out pixel value.

[0052] The apparatus comprises:

[0053] means for obtaining a difference about the pixel value among thepixels at arranged positions corresponding to first and second fieldsdetected through color filters of the mutually same color arrangementevery said regions; and

[0054] means for judging that when a difference between two pixelsexceed a predetermined threshold, one pixel of the two is the defectingpixel and for amending a pixel value of the one pixel based on a pixelvalue of the other pixel of the two.

[0055] The pixel value of said one pixel is rewritten by the pixel valueof the other pixel.

[0056] The apparatus further comprises means for obtaining a differencebetween a predicated value predicated by a pixel value of each pixel ofa third field from each pixel of the first and second fields and a pixelvalue obtained from each pixel of the third field, and means for judgingthat when the difference obtained by the said means for obtaining thedifference exceeds said predetermined threshold, the pixel of the thirdfield is said defective pixel and for rewriting the pixel value of thedefective pixel by said predicated value.

[0057] When a photographing mode of indicating elimination of the numberof pixels is selected, a field having a less defective pixel is selectedabout all three original colors, and an image of one frame is formedfrom a pixel value of pixel of the field. The photographing mode is acontinuous taking-out mode.

[0058] A correcting device for defect of ordinary temperature isprovided at prior to said correcting device for white defect oftemperature. The correcting device for defect of ordinary temperatureamending a defect of ordinary temperature which does not depend ontemperature of said pixel previously to effect amendment of the pixelvalue of the defective pixel by said correcting device for white defect.

[0059] Further, a photographing method is provided, in one embodiment,it comprises the steps of:

[0060] preparing a solid photographing device which has a plurality ofpixels compartmentalized in every predetermined regions and in which apixel for detecting a pixel value of each color of three original colorsthrough a color filter of said plurality of pixels is arranged in saidregions, said photographing device being determined so that a defectingpixel for generating a white scratch of temperature which changesaccording to temperature is one or less in each region, each pixel valueof all the pixels in the solid photographing device being read out withdivision of fields of three or more to form an image of one frame basedon the read out pixel value;

[0061] obtaining a difference about the pixel value among the pixels atarranged positions corresponding to first and second fields detectedthrough color filters of the mutually same color arrangement every saidregions; and

[0062] judging that when a difference between two pixels exceed apredetermined threshold, one pixel of the two is the defecting pixel andfor amending a pixel value of the one pixel based on a pixel value ofthe other pixel of the two.

[0063] In the other embodiment, a photographing method comprises thesteps of:

[0064] dividing data transfer of electrification of all pixels storedcorresponding to an image focused on an photographing device having acolor filter for resolving color by means of a focused means into M(≧3)fields; and

[0065] carrying out image processing including at least YUV conversionby use of transfer data of m (<M) fields in which all color signals andnecessary number of pixel are get.

[0066] In one embodiment, number of fields: M is odd number of 3 ormore, m=1.

[0067] In the other embodiment, number of fields: M is even number of 4or more, m=2.

[0068] When the transfer data of m field is get, image processingincluding at least YUV conversion is immediately carried out.

[0069] An image for confirming photographing is made by image processingincluding YUV conversion.

[0070] A thumbnail image is made by image processing including YUVconversion.

[0071] Condition of an image to be formed is set and image processing iscarried out by use of transfer data of n (m≦n≦M) field to make saidimage to be formed.

[0072] Condition of an image to be formed is resolution of image and nis number of field in which number of pixel necessary to make an imageof the set resolution is get.

[0073] As an example, M=3, an image of low resolution is prepared withrespect to number of field: n=1, an image of middle resolution isprepared with respect to number of field: n=2, and an image of highresolution is prepared with respect to number of field: n=M.

[0074] In one example, M=4, an image of low resolution is prepared withrespect to n=2, images of middle and/or high resolutions are preparedwith respect to number of field; n=M.

[0075] In one example, M=6, an image of high resolution is prepared withrespect to n=M, an image of low resolution is prepared with respect tonumber of field: n=2 or an image of middle resolution or low resolutionis prepared with respect to number of field; n=4.

[0076] Condition of an image to be formed is compressibility of image,and n is number of field in which number of pixel necessary to make theimage of the set compressibility is get.

[0077] In one example, M=3, processing of compressing the image iscarried out on format of JPEG with respect to number of field: n=1.

[0078] In the other example, M=4 or 6, processing of compressing theimage is carried out on format of JPEG with respect to number of field;n=2.

[0079] Further, an photographing apparatus is provided comprising;

[0080] a photographing device having a color filter for resolving color;

[0081] photographing means for focusing an image to be photographed onsaid photographing device;

[0082] a photographing processing part for converting to digital signalelectrification stored in said photographing device and transferred; and

[0083] means for carrying out image processing including at least YUVconversion by use of transfer data transferred through said imagingprocessing part, wherein said photographing device is interlacetransferring type and divides data transfer of electrification of storedall pixels into M(≧3) fields.

[0084] The color filter of the photographing device is composed oforiginal colors of red (R), green (G) and blue (B).

[0085] The color filter of the photographing device is composed ofcomplementary color of yellow (Y), cyan (C), magenta (M) and green (G).

[0086] In one example, M is 3 in the photographing device of interlacetransferring type, and said apparatus embodies said photographing methodas recited in claim 29 or 34.

[0087] In one example, M is 4 or 6 in the photographing device ofinterlace transferring type, and said apparatus embodies saidphotographing method as recited in claim 30, 31 or 34.

[0088] The apparatus can embodies the photographing method and has adisplaying part for displaying an image for confirming pick up and/or animage of thumbnail.

[0089] The apparatus has also a removable exterior memory for storingthe formed image.

[0090] The apparatus has an image holding section for storing the formedimage.

[0091] An information processing apparatus of image comprising saidphotographing apparatus is also provided.

BRIEF DESCRIPTION OF THE DRAWINGS

[0092]FIG. 1 is a block diagram substantially illustrating theconstruction of a digital camera including a photographing apparatus ina first preferred embodiment of the present invention;

[0093]FIG. 2 is a schematic view illustrating the transfer of data on aphotographing device (CCD: Charge Coupled Device) in a 3:1 interlacingtransfer system containing all RGB signals in each field by dividing atransfer medium into 3 fields for transferring electric charges storedin the CCD in the first embodiment of the present invention;

[0094]FIG. 3 is (a) a front view, (b) a side view, and (c) an upper viewrespectively illustrating an external appearance of a digital cameraincluding the photographing apparatus in the embodiment of the presentinvention;

[0095]FIG. 4 is a view illustrating color filters each for R, Gr signalsin a primary color system, and for Ye, Cy signals and Mg, G signals in acomplementary system;

[0096]FIG. 5 is a flow chart illustrating the operation of the foregoingembodiment of the present invention;

[0097]FIG. 6 is a view exemplarily illustrating a display on a setscreen for recording in a digital camera in the embodiment of thepresent invention;

[0098]FIG. 7 is a schematic view illustrating the transfer of data in aprior art photographing device in an interlacing transfer system;

[0099]FIG. 8 is a block diagram substantially illustrating theconstruction of a digital camera including a photographing apparatus ina preferred embodiment of the present invention;

[0100]FIG. 9 is a schematic view illustrating the transfer of data in aphotographing device (CCD) in a 3:1 interlacing transfer system in whicha transfer passage for electric charges stored in a CCD in theembodiment of the present invention is divided into 3 fields, includingall RGB signals in each field;

[0101]FIG. 10 is (a) front view, (b) a side view, and (c) an upper viewillustrating an external appearance of the digital camera including thephotographing device in the embodiment in FIG. 9;

[0102]FIG. 11 is a view illustrating color filters for R, Gr signals ina primary color system and for Ye, Cy signals and Mg, G signals in acomplementary color system;

[0103]FIG. 12 is a flow chart illustrating the operation of a preferredembodiment of the present invention

[0104]FIG. 13 is a block diagram illustrating the substantialconstruction of a digital camera including a photographing apparatus inanother preferred embodiment of the present invention;

[0105]FIG. 14 is a schematic view illustrating the transfer of data froma photographing device (CCD) in a prior art interlacing transfer system;

[0106]FIG. 15 is a block diagram substantially illustrating cameraaccording to the present invention;

[0107]FIG. 16 is views (a), (b), and (c) of the operations exemplarilyillustrating the read operations in the respective fields for all pixelsin a 3 field read type CCD illustrated in FIG. 15;

[0108]FIG. 17 is (a) a view illustrating a transfer system for electricchanges in a 2 field read type CCD, and (b) a view illustrating atransfer system for electric changes in a 3 field read type (c) in thedigital camera illustrated in FIG s. 15 and 16;

[0109]FIG. 18 is (a) a view illustrating the exemplary arranged of colorfilters in one region of an image on the CCD illustrated in FIG. 15, and(b) to (d) are views each illustrating an example of a color arrangedfor each field in the one region,

[0110]FIG. 19 is views each illustrating a change of stored data in eachmemory frame in the operation of the digital camera illustrated in FIG.15, (a) a read example of the first field, (b) a read example of thesecond field, (c) a calculation example for a predicted value of thethird field, and (d) a read example of the third field;

[0111]FIG. 20 is a view illustrating a calculation processing example ofpixel data in one region where there is a blue defect on a blue color inthe first field;

[0112]FIG. 21 is such a view as in the same fashion illustrated in FIG.20 about one region where a temperature defect is existent on a redcolor in the first field;

[0113]FIG. 22 is a similar view to that illustrated in FIG. 20 withrespect to one region where a temperature defect is existent on a redcolor in the first field;

[0114]FIG. 23 is a similar view to that illustrated in FIG. 20 withrespect to one region where a temperature defect is existent on a bluecolor in the second field;

[0115]FIG. 24 is a similar view to that illustrated in FIG. 20 withrespect to one region where any temperature defect is existent on agreen color in the second field;

[0116]FIG. 25 is a similar view to that illustrated in FIG. 20 withrespect to one region where any temperature defect is existent on a redcolor in the second field;

[0117]FIG. 26 is a similar view to that illustrated in FIG. 20 withrespect to one region where any temperature defect is existent on a bluecolor in the third field;

[0118]FIG. 27 is an identical view in FIG. 20 with respect to one regionwhere a temperature defect is existent on a green color in the thirdfield;

[0119]FIG. 28 is an identical view in FIG. 20 with respect to one regionwhere any temperature defect is existent on a red color in the thirdfield;

[0120]FIG. 29 is a timing chart illustrating the operation of readingfor 3 fields in the digital camera illustrated in FIG. 1;

[0121]FIG. 30 is a timing chart illustrating the read operation in 2fields in the digital camera illustrated in FIG. 1;

[0122]FIG. 31 is a view illustrating the system arranged of anelectronic still camera being a preferred embodiment of a photographingapparatus or an image information processing apparatus;

[0123]FIG. 32 is a view illustrating one embodiment of the electronicstill camera illustrated in FIG. 31;

[0124]FIG. 33 is views illustrating a color filter for colordecomposition included in a photographing device, (a) one in a primarycolor system and (b) one in a complementary system;

[0125]FIG. 34 is a view illustrating an interlacing transfer system inthe case of M=3;

[0126]FIG. 35 is a view illustrating one example of settingphotographing conditions;

[0127]FIG. 36 is a flow chart illustrating one embodiment of thephotographing method for use in the photographing device in theinterlacing transfer system in FIG. 34;

[0128]FIG. 37 is a view illustrating the interlacing transfer system inthe case of M=4; and

[0129]FIG. 38 is a flow chart illustrating one embodiment of aphotographing method for use in the photographing device in theinterlacing transfer system in FIG. 37.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0130] In what follows, there will be described the preferredembodiments of the present invention with reference to the accompanyingdrawings.

[0131] Referring to FIG. 1, a block diagram illustrating theconstruction of a digital camera including a photographing apparatus ina preferred embodiment of the first invention is provided. The preferredembodiment exhibits as an example a photographing apparatus employing aphotographing device in a 3:1 interlacing transfer system containing allRGB signals in each field by dividing electric charges stored in thephotographing device to 3 fields upon transferring the electric charges.

[0132] In FIG. 1, designated at 101 is a photographing device (referredhereinafter to as a CCD.) which includes a primary color system RGBcolor filter and transfers electric charges by dividing them to 3fields, 102 is a photographing/processing section (including CSD:Correlated Double Sampling Circuit, AGC (Automatic Gain ControlCircuit), A/D (Analog/Digital Converter Circuit), TG (Timing GenerationCircuit, etc.), which takes out an image focused on a CCD surface afterentering the same surface through a group of photographing lenses and ashutter as an analog image signal and converts it to a digital imagesignal, 103 is a signal processing section for executing a processingsuch as storing a digital image signal in a memory section (SDRAM) 104through the CCD-I/F 3 a, and a memory controller 3 b, 105 is a controlsection (CPU) for controlling each section, 106 is a display section fordisplaying an image for confirming photographing and a thumb-nail image,and 107 is an operation section for inputting each setting for thedigital camera.

[0133] Referring further to FIG. 2, a schematic is provided illustratingthe transfer of data in CCD, on which there are provided color filtersof a primary color system in a 3:1 interlacing transfer systemcontaining all RGB signals in each field obtained by dividing electriccharges stored in the CCD in the present embodiment into 3 fields uponthe transfer of those electric charges.

[0134] Referring further to FIG. 3(a), a front view is providedillustrating an external appearance of the digital camera including thephotographing apparatus in the present embodiment, with FIG. 3(b) a sideview of the same and FIG. 3(c) an upper surface view of the same.

[0135] In a frame for executing transfer while assuming vertical 3 linesas 1 group, data is transferred assuming the line on which a numeral “1”is written as the first field, as illustrated in FIG. 2. The first fieldcontains all components in the RGB signals. The image data is obtainedon the basis of the transfer data containing all the RGB signals afterthe transfer of the first field has been completed.

[0136] After the transfer of the first field has been completed, thesecond and third fields are transferred respectively. R, Gr signals andB, Gb signals in the primary system illustrated in FIG. 2 may bereplaced by Ye, Cy signals and Mg, G signals in the complementary colorsystem (Refer to FIG. 4.).

[0137] In the following, the operation of the present embodiment will bedescribed with reference to a flow chart in FIG. 5 and FIG. 1. First,data corresponding to the first field among the 3 fields as data ofelectric charges stored in the CCD lin response to an image being aphotographing object is transferred, and the transferred data are storedin the memory section 104 after mediating the photographing processingsection 102 and then the CCD-I/F 103 a in the signal processing section3 and the memory controller 103 b in step S1. It is confirmed that thetransfer of the data in the first field has been completed in step S2,and at the time the data transfer has been completed (Yes in S2) it isconfirmed whether or not setting for displaying an image for confirmingthe photographing is existent in step S3. Since all the data of the RGBsignals of a pixel are contained in the data transferred from the firstfield, the image processing can be executed at the time the transfer hasbeen completed.

[0138] When the operation is setting for displaying of the image forconfirming the photographing in the processing S3 (Yes in S3), there isexecuted an image processing to prepare the image for confirming thephotographing on the basis of the transfer data in the first field instep S4.

[0139] Further, when the operation is not setting for displaying of theimage for confirming the photographing in the processing S3 (No in stepS3), or after the finishing of the processing S4, an image processingfor preparing a thumb-nail image is executed in step S5. Further, it isconfirmed whether or not a resolution of an image to be prepared is setto be “low” in step S6, and when the setting is the “low” resolution(Yes in S6), the image processing is executed using the transfer data inthe first field in step S7.

[0140] When the setting is not the “low” resolution (No in step S6), itis confirmed in step S6 whether or not the transfer of data in thesecond field has been completed, and further it is confirmed whether ornot the resolution of an image to be prepared is set to “middle” in stepS9. When the setting of the resolution is “middle” (Yes in step S9), theimage processing is executed using the transfer data in the first andsecond fields in step S10.

[0141] Further, when the setting is not the “middle” resolution in S9(No in S9), it is confirmed in step S11 that data transfer for the thirdfield has been completed, and an image processing providing a highresolution is executed using the transfer data in the first, second, andthird fields in step S12.

[0142] As described above, the transfer data from the CCD 101 are storedin the memory section 104 (RAW-RGB region) mediating the photographingprocessing section 102 and the CCDI/F 103 a in the signal processingsection 103 and the memory controller 103 b.

[0143] For the transfer data in each field, as described previously inFIG. 5, the data of the RGB signal stored in the memory section 104(RAW-RGB region) through the memory controller 103 b owing to thedetection of the completion of the transfer of each field in response tothe setting of the photographing confirmation image, and “low”,“middle”, and “high” of the resolution by a user are converted to thedata of the YUV signal by the YUV (brightness color difference signal)conversion section 3 c and is again stored in the memory section 104(YUV region).

[0144] For example, the photographing confirmation image and thethumb-nail image prepared on the basis of the transfer data in the firstfield are displayed on the display section 106 through the displaysection I/F 103 e. Further, upon the setting of the resolution “low” thedata of the YUV signal is read from the memory section 104, and issubjected to a compression processing into a JPEG format, and is storedin the memory section 104 (JPEG region). Further, upon the date beingstored in the memory section 104 (JPEG region) header data and the likeare added to the data subjected to the JPEG compression, and are storedin the external memory section 104′ by the control section 105 as theJPEG image data.

[0145] Further, upon the setting of the resolution “middle” the imageprocessing is achieved using the transfer data in the first and secondfields based upon the detection of the completion of the data transferin the second field, and upon the setting of the resolution “high” theimage processing is achieved using the transfer data in the first,second, and third fields based upon the detection of the completion ofthe data transfer in the third field.

[0146] To be concrete, when the CCD with 3 million pixels of horizontal2048 pixels and vertical 1536 pixels is used, in the interlacingtransfer system where divided transfer by 3 times is executed, data withhorizontal 2048 pixels and vertical 512 pixels is transferred by the onetime transfer. For this, when the size of horizontal 640 pixels andvertical 480 pixels (VGA) is recorded, an image can be formed on thebasis of the number of transfer pixels in the first field. Further, datawith horizontal 2048 pixels and vertical 1024 pixels is provided usingthe number of transfer pixels in the first and second fields(corresponding to 2 times) to form an image with the size of horizontal1024 pixels and vertical 768 pixels (XGA) and with the size ofhorizontal 1280 pixels and perpendicular 1024 pixels.

[0147] Although when use is made of the transfer data in the first,second, and third fields, an image is extended horizontally with adifferent aspect ratio between horizontal pixels and vertical pixels,the aspect ratio can be adjusted by executing a processing such asreading with thinning from the memory section upon the conversionprocessing in the YUV conversion section.

[0148] Herein, provided that it is purposed to obtain the recording ofan image with the size of VGA like the photographing confirmation imageand the thumb-nail image, a photographed image can be satisfactorilyprocessed with the transfer data in the first field, so that theprocessing of the data transfer in the first and second fields can beinterrupted, and the processing jumps to the next photographing to speedup the processing. More specifically, use is made of transfer data in afield required for an image processing in response to the setting of aresolution, and the next photographing is started without executing datatransfer in an unnecessary field.

[0149] Further, it is also possible to select transfer data in thefirst, second, and third fields transferred from the CCD for imageprocessing in response to the setting of a compression ratio. Forexample, when an image is desired to be recorded and transmittedquickly, a choice is frequently made of a high compression ratio. So,when a high compression ratio is set, image processing is executed usingtransfer data in the first field, and in a middle compression ratiotransfer data in the first and second fields are used and in a lowcompression ratio transfer data in the first, second, and third fieldsare used.

[0150] Referring to FIG. 6, there is provided a view exemplarilyillustrating a select screen for setting a resolution on a liquidcrystal monitor that is a display section of a digital camera. Asillustrated in FIG. 6, at items of photographing confirmation image inthe recording/setting screen a display “off” or display time “1 sec”, “3sec” are set, and at the item of a recorded image resolution “high”,“middle”, and “low” are inputted and set from an operation section.Further, also in the image compression ratio identical display isachieved and set with the choice of a user.

[0151] Although in the aforementioned description the data transferdivided into the three fields was taken as an example, provided that thenumber of pixels on the photographing device is increased with thetransfer time of the number of all pixels being increased from now on,and further the VGA size is obtained from the number of transfer pixelsin the divided 1 field, it is also considered that the number of dividedfields is increased as in the case where pixels are divided into 5fields for data transfer.

[0152] As described above, a high speed image processing is achieved byselecting an optimum processing in response to the setting of an imageoutput previously set by a user.

[0153] In accordance with the present invention, as described above,upon transferring electric charges stored in a photographing device useis made of a photographing device in an interlacing transfer systemwhere all color signals are contained in one field, and once datatransfer in one field is finished, image data can be formed, andconfirmation of a photographed image, shortening of processing timeuntil the next photographing is started, and further an improvement ofconvenience of a user are achieved.

[0154] In the following, there will be described in detail a preferredembodiment of the second invention with reference to accompanyingdrawings.

[0155] Referring to FIG. 8, there is provided a block diagramsubstantially illustrating the construction of a digital cameraincluding a photographing apparatus in the preferred embodiment of thesecond invention. In the present embodiment, there is exemplarily takena photographing apparatus using a photographing device in a 3:1interlacing transfer system containing all RGB signals in each field bydividing the electric charges into three fields upon the electriccharges stored in the photographing device being transferred.

[0156] In FIG. 8, designated at 210 is a photographing device(hereinafter, simply referred to as a CCD.) in which RGB color filtersin a primary color system are provided for transferring electric chargeswhile dividing the transfer 3 times; 202 is a photographing/processingapparatus for taking out as an analog image signal an image incident andfocused on a CCD surface through a group of photographing lenses and ashutter, and converting it to a digital image signal (including a CSD(Correlated Double Sampling Circuit), an AGC (Automatic Gain ControlCircuit), an A/D (Analog/Digital Conversion Circuit), and a TG (TimingGeneration Circuit), etc.); 203 is a signal processing section forstoring a digital image signal in a memory section (SDRAM) 204 through aCCD-I/F 203 a and executing processing such as extracting characteristicdata in an image; and 206 is a control section (CPU) for generating acontrol value for use in image correction based upon the extractedcharacteristic data, and controlling the respective sections.

[0157] Referring further to FIG. 9, there is provided a schematic viewillustrating the data transfer in the CCD on which there are providedcolor filters in a primary color system in a 3:1 interlacing transfersystem where upon transferring electric charges stored in the CCD thetransfer is divided into 3 fields and all RGB signals are contained ineach field, with FIG. 10(a) being a front view illustrating an externalappearance of the digital camera including the photographing apparatusin the present embodiment, with FIG. 10(b) a side view, and with FIG.10(c) an upper view of the same.

[0158] As illustrated in FIG. 9, in a frame where 3 vertical lines areassumed as 1 group for transfer of data transfer is first executedassuming a line indicated by a numeral “1” a first field. The firstfield contains all components of the RGB signals. The characteristicdata of an image formed by transfer data containing all the RGB signalscan be obtained after the first field has been transferred.

[0159] After the transfer of the first field has been completed, thesecond and third fields are transferred, respectively. Further, it ispossible to replace R, Gr signals and B, Gb signals in a primary colorsystem illustrated in FIG. 9 by Ye, Cy signals and Mg, G signals in acomplementary color system (see FIG. 11.).

[0160] In the following, the operation of the present embodiment will bedescribed on the basis of a flow chart illustrated in FIG. 12. In thefirst place, as data of electric charges in the CCD 201 stored inresponse to a photographing object image data transfer corresponding tothe first field among the divided three fields is executed in step S1.

[0161] The characteristic data of an image is extracted with the CCD-I/F203 a of the signal processing section 203 through thephotographing/processing section 202 and is stored in the memory section204 in step S2.

[0162] At the time the data transfer in the first field is completed alldata of the RGB signals of a pixel are transferred, so that thecharacteristic data of the image can be obtained at the time thetransfer of data in the first field has been completed. Hereby, acontrol value can be calculated from the characteristic data just sincethe data transfer in the second fields is started in step S3. Morespecifically, even in the course of the transfer of data in the secondand third fields calculation of a control value for use in the nextimage processing can be started.

[0163] Further, after the data in the second field is transferred, thedata in the third field is transferred in step S4, and after thetransfer of all the data in the first to third fields has been finallycompleted in step S5, the data of the RGB signals stored in the memorysection 204 (RAW-RGB region) through the memory controller 203 b isconverted to the data of the YUV signal through the YUV (brightnesscolor difference signal) conversion section 203 c, and is again storedin the memory section 204 (YUV region). In the time of the conversionuse is made of a control value generated in the control section 205 onthe basis of the previously extracted characteristic data in step S6.

[0164] Further, the data of the YUV signal is again read from the memorysection 204, and is subjected to a compression processing into a JPEGformat for example with the compression processing section 203 d and isstored ion the memory section 204. Further, upon the data being storedin the memory section 204 (JPEG region) header data, etc., are tagged tothe JPEG compressed data into JPEG image data, and is stored in theexternal memory section 204′ with the control section 205 in step S7.

[0165] Although in the aforementioned example, after the transfer of theprocessing of the data of all pixels in the 3 fields had beentransferred, the processing of the YUV conversion was started, even inthe course of the transfer of data in the third field part of the data,the transfer of which has been already completed, contains the data ofall the RGB signals, so that it is possible to start the imageprocessing, and according to the method the YUV conversion can befinished more rapidly.

[0166] As the characteristic data for generating a control value for usein the YUV conversion where the image processing is concretely executedthere are employed color distribution data for control which calculatesthe gain of white balancing, brightness data of a plurality of areasobtained by dividing a screen for use in setting of a contrast where abrightness distribution is made uniform, output data of the image datafrom a high pass filter for calculating an image edge emphasizingcoefficient corresponding to the size of an output signal emphasizingthe edge of an image, and further color information of the respective isobtained by dividing a screen into a plurality of the areas. Forexample, when it is recognized from the color distribution that a personis photographed, a color conversion coefficient where the tone of a skincolor is reproduced to a more preferable one is calculated, and an imageprocessing is executed where the YUV conversion using the present colorconversion is executed.

[0167] Referring here to FIG. 13, a block diagram illustrating thesubstantial construction of a digital camera including the photographingapparatus in the above described embodiment of the present invention isprovided. Identical symbols shall be applied to those having identicalfunctions corresponding to constituent members in the embodimentillustrated in FIG. 8.

[0168] Also in the present embodiment, in the same fashion as in theaforementioned embodiment, a photographing apparatus is provided, whichemploys a photographing device in a 3:1 interlacing transfer system inwhich upon transferring electric charges stored in the photographingdevice the transfer is divided into three fields, each of which fieldscontains all the RGB signals.

[0169] As illustrated in FIG. 13, a CCD 1 is that following a 3:1interlacing transfer system in which RGB signals in a primary colorsystem are contained and the transfer is divided into three times. Inthe present embodiment, there are set to the CCD-I/F 203 a the foregoingwhite balance gain adjustment for an image, a contrast set value, anedge emphasizing coefficient, and a color conversion coefficient. Morespecifically, in the construction where the control value is set in theinitial stage of the image processing section 203 the use of the controlvalue prepared from the obtained characteristic data resolves a problemthat such a processing as reflecting the prepared control value for theimage obtaining the characteristic data is impossible, and assures theprocessing.

[0170] Herein, there will be described a photographing apparatus forextracting the characteristic data of an image with the data transfer inthe first field, and calculating and setting control values based uponthe characteristic data in the course of the data transfer in the secondfield when image formation is executed on the basis of the data transferin one field without the use of all pixels corresponding to one frame,for example the image formation is executed using only the third field.

[0171] When use is made of a CCD of 3 million pixels of horizontal 2048pixels and vertical 1536 pixels, in an interlacing transfer system where3 times division transfer is executed, data of the horizontal 2048pixels and of the vertical 512 pixels are transferred with only one timetransfer. For this, when the size of the horizontal 640 pixels and thevertical 480 pixels (VGA) is recorded, an image is formed with thenumber of transfer pixels corresponding to one time transfer (1 field).

[0172] Electric charges of an image focused on the surface of the CCD201 are taken out with the CCD 201 as an analog image signal. The analogimage signal is converted to a digital signal with thephotographing/processing section 202 (CDS, AGC, A/D), and is stored inthe memory section 204 b through the CCD-I/F 203 a of the signalprocessing section 203, and at the time the data transfer through thefirst field is completed, the YUV conversion is executed for thetransfer data through the first field, and further image characteristicdata generated upon the conversion is read out by the control section205.

[0173] The processing is processed in the course of the data transferthrough the second field, and a control value is calculated from imagecharacteristic data read in the control section 2905 and is set in theCCD-I/F 203 a. Upon the data transfer through the third field thecontrol value becomes effective for all the pixels of the transfer data,whereby the control value using image characteristic data of aphotographed data can be reflected on a screen for photography.

[0174] Further, as in the same fashion as in the previous embodiment,the data of the RGB signal through the third field are read out from thememory section (SDRAM) 204, and are YUV-converted in the YUV conversionsection 203 c, and are JPEG-compressed by the compression processingsection 203 d, and are stored in the external memory section (memorycard) 204′ as a JPEG image file.

[0175] In the foregoing processing, and although in the same fashion asin the previous embodiment, aspect ratios of horizontal and verticalsizes are not coincident with each other, but the aspect ratio can beadjusted by executing reading with thinning from the memory section(SDRAM) 204 upon the transfer to the YUV conversion section 203 for theYUV conversion for example.

[0176] Although in the construction illustrated in FIG. 13 thecharacteristic data is extracted in the YUV conversion section 203 c,the characteristic data may be extracted in the CCD-I/F 203 a in thesame fashion as in the first embodiment, and it is also possible toobtain the characteristic data in the first field, prepare a controlvalue upon the data transfer through the second field and set it to theCCD-I/F 203 a, and reflect the control value on the data transferthrough the third field.

[0177] In the same fashion, when a binary processing is executed in aphotographing apparatus capable of processing a binary image, athreshold for discriminating a bright portion and a dark portion ispreviously determined to judge them with the image characteristic datafrom the transfer data corresponding to the 1 fields.

[0178] In other words, in an apparatus for frequent use underphotographing conditions not limited to those where the entire surfaceof an object is always illuminated with the same illumination as in adigital camera, a screen is divided into small areas, brightnessdistribution on which area is detected, and a threshold in each areamust be determined.

[0179] For detecting the brightness distribution, in a primary colorsystem photographing device, all data of the RGB signals are requiredover the entire surface of a screen, so that the threshold of each areacan be calculated before the data transfers in the second and thirdframes are finished on the basis of the data of the RGB signals writtenin the memory section (SDRAM) 204 in the data transfer through the firstfield, and when the data transfer has been finished, the binaryprocessing can be started using the calculated threshold. It is alsopossible to calculate the threshold using the brightness distributionbeing the image characteristic data in the first field.

[0180] From the above description, the characteristic data of an imageis obtained on the basis of the transfer data in the first field, andbefore incorporation of the transfer data in the remaining fields isfinished, the calculation of the control value for use in the imageprocessing is started to speed up the image processing.

[0181] As described above, in accordance with the present invention, thetransfer of stored electric charges is divided into three fields, andall color signal components can be obtained with the data transfer inthe first field by making used of the photographing device in the 3:1interlacing transfer system including all color signals in each field,so that characteristic data of an image over the entire surface of ascreen is obtained on the basis of the transfer data, and by startingthe calculation of the control value for use in the image processingthereafter, with respect to a range where incorporation of the transferdata in each field is completed the processing can be started beforeincorporation of the transfer data in the remaining field is completed,to speed up the image processing.

[0182] The digital camera associated with the present inventioncomprises as illustrated in FIG. 15, a CCD 402 for converting an opticalimage of an object to be photographed obtained through a photographinglens 401 to an analog electric signal, a CD (&RUUHODWHG′ RXEOH6DPSOLQJ-correlation double sampling)•A/D circuit 403 including ananalog/digital converter, for subjecting an analog image signaloutputted from the CCD 402 to sample holding and analog/digitalconversion successively, a digital signal processing circuit (DSP) 406including a temperature white defect correction apparatus 404 forcorrecting any temperature white defect that is one of image defects inthe CCD for a digital image signal converted by the CDS•A/D circuit 403and a signal processing circuit 405 a for applying a predetermined imageprocessing to the corrected digital image signal corrected by thetemperature white defect correction apparatus 404, and the like, and anSDRAM 419 for temporarily storing image data.

[0183] The CCD 402 being a solid photographing device includes thereincolor filters as described later. Between the photographing lens 401 andthe CCD 402 a mechanical shutter 406 is inserted, which shutter ensuresthe photographing for a still image in the interlacing type CCS 402.Operations of these constituent sections 402-406 are controlled with acontrol section 409 composed of a microcomputer (MPU). A timinggenerator TG alters the operation modes with the operation of a release408 provided on the operation section of the digital still camera.

[0184] In examples illustrated in FIG s. 16(a) to 16(c), for a readingsystem from the optical detection cells 411 constituting respectivepixels of the CCD 402 an interline transfer system using verticaltransfer registers 412 arranged among vertical lines of the opticaldetection cells 411 is adopted. Accordingly, electric charges stored ineach optical detection cell 412 in an exposure process are amplified inan output amplifier 24 provided on the horizontal transfer register 413after passage through the vertical transfer register 412 composed of theCCD and through the horizontal transfer register 413 composed of theCCD, and are outputted to the CDS•AD circuit 403 as an analog imagesignal.

[0185] In order to read electric charges stored in the CCD, in a generalinterlacing CCD all the optical detection cells of the CCD, i.e., allpixels (Part of there of is illustrated in the figure.) are classifiedinto two fields, as illustrated in FIG. 17(a). The one field isconstituted with a group of pixels of any one for each set composed ortwo pixels adjoining vertically and alternately arranged, while theother field is constituted with the other group of pixels for each set.The stored electric charges from the optical detection cells are read tothe vertical transfer register for each field with the aid of 4 phasevertical transfer gate signals V1 to V4, and are transferred to thehorizontal register following the movement of a potential wellconstituted with the vertical transfer register. Against this, in theCCD 402 associated with the present invention, as illustrated in FIG.17(b), all pixels, i.e., all the optical detection cell 411 (partlyillustrated in the figure.) are divided into three fields composed ofthe group of the pixels of the 3 sets disposed periodically vertically,and fundamentally an image of one frame is constructed with these threefields.

[0186] Although in the CCD 412 of the 3 field read type the size of theoptical detection cell 411 is more reduced than that of each opticaldetection cell of the CCD of the 2 field read type illustrated in FIG.17(a), identical reading of electric charges in the 2 field read type isensured.

[0187] Referring further to FIG. 16, in 16(a) an example of reading fromthe pixels 411 in the A field being the first field is partlyillustrated, and in 16(b) an example of reading from the pixels 411 inthe B field being the second field is partly illustrated, and further inFIG. 16(c) an example of reading from the pixels 411 in the C fieldbeing the third field is partly illustrated. Since in the examples inFIG. 16 there are contained R, G, B in a primary color system for everyfield, there is ensured a color processing by the value of the pixel inany one field.

[0188] In order to obtain such a color arrangement, there can be used afilter in an RGB primary color system having such a color arrangement ofa zig-zag pattern as illustrated in FIG. 18 for example, which isconventionally well known. The color arrangement of the filters in theRGB primary color system illustrated in FIG. 18(a) includes a colorfilter corresponding to pixels 411 of 9×9 for example obtained when allthe pixels 21 of the CCD 402 are defined in a predetermined region.

[0189] A region of the color filter designated at R is a red filterregion which arrests transmission of light other than red light, with aregion designated at B is a blue filter region which arrests thetransmission of light other than blue light. Gr and Gb indicate a greenfilter region which arrests the transmission of light other than greenlight, where the former is a green filter region disposed on a row onwhich the red filter region is arranged, and the latter is a greenfilter region disposed on a row on which the blue filter region isarranged.

[0190] The CCD 402 including therein such color filters is manufacturedwhile being subjected to quality control so as to satisfy a prescriptionthat a defective pixel which provides any temperature white defect whichmight being caused by a dark current of a specified value or more lessthan 1 in a predetermined region, for example in each region for every9×9 pixels for example, and ones satisfying the specification areavailable as general commodities. Accordingly, in such a CCD 402 onlythe existence of only one temperature white defect may be allowed ineach the foregoing predetermined region.

[0191] In FIGS. 18(b) to 18(d) the color arrangement of pixels in eachfield is extracted, and color arrangements in the A field in FIG. 18(b)and the B field in FIG. 18(c) are coincident with each other.

[0192] In the present process of exposure to light with the operation ofthe release 408 the mechanical shutter 406 is kept in an open state, andhenceforth stored electric charges in response to an optical image of anobject to be photographed obtained through the photographing lens 401are stored in each pixel comprising the optical detection cell 411 ofthe CCD 402 owing to the present exposure to light.

[0193] When the stored electric charges reach a predetermined quantity,the mechanical shutter 406 is closed. The stored electric charges areread on the vertical transfer passage 412 (see FIG. 16) in response to acombination of outputs of V1, V3A, B, V5A, B followed by a read pulse asillustrated in FIG. 29 among V1 to V6 being an output of the V driver410 in a frame read process where the mechanical shutter 406 is in aclosed state of the mechanical shutter 406, and a pixel signalcorresponding to FIGS. 18(b) to 18(d) for each field. The outputtedimage signal undergoes sampling hold•A/D conversion in the CDS•A/Dcircuit 403, and is sent to the temperature white defect correctionapparatus 404 as a digital image value.

[0194] The temperature white defect correction apparatus 404 associatedwith the present invention comprises first and second frame memories415, 416 each having a memory capacity required for storing a digitalpixel value in each field constructed with the pixels 411 of ⅓ of allthe pixels 411 of the CCD 402, a subtraction circuit 417, a colorinterpolation circuit 418, and a control section 419.

[0195] The frame memories 415, 416, the subtraction circuit 417, and theinterpolation circuit 418 are controlled by the control section 419.Once a digital value of each pixel in the B field from the sampling holdcircuit 403 is outputted with reading of the value of each pixel in theB field on 419. Once the value of each pixel in the A field outputtedfrom the CCD 402 by reading of the value of each pixel in the A field isoutputted as a digital value from the CCD 402, the control section 409stores without correcting an RGB Image value in an external SDRAM 419and stores in a first frame memory 415, as illustrated in FIG. 19(b).Further, the subtraction circuit 417 subtracts the value (B) of eachpixel in the B field from each pixel value in the (A) field stored inthe first frame memory 415 with the control of the control section 419successively. The reduction result (A-B) is written in the second framememory 416 with the control section 409.

[0196] The subtraction between the value of each pixel in the A fieldand the value of each pixel in the B field by the subtraction circuit417 is executed for each predetermined region illustrated in FIG. 18(a).In each the foregoing region, as illustrated in FIG s. 18(b), (c) bothfields A and B are disposed in the color arrangement where their colorarrangements are coincident with each other, so that the subtraction isexecuted between pixels with the same color corresponding to the orderof the arrangements.

[0197] More specifically, an R value (B field) at third row first columnis subtracted from an R value (A field) at first row first columnillustrated in FIG. 18(a), and the result is written in the second framememory 416, and thereafter respective differences of a Gr value (Bfield) at 3 rd row 2 nd column from a Gr value (A field) at 1 st row 2nd column . . . an R value (B field) at 9 th row 9 th column from an Rvalue (A field) at 7 th row 9 th column are written in the second framememory 416.

[0198] The control section 409, when the respective subtraction resultsare compared with a predetermined threshold region, and fall w3ithin thethreshold region, judges that no temperature white defect occurs onpixels of one set providing the subtraction result. In contrast, whenthe subtraction result exceeds the predetermined threshold range, itjudges that any temperature white defect occurs on any one among a setof pixels providing the subtraction result. Such judgement is executedfor every the foregoing region.

[0199] The judgment on the temperature white defect is ensured for everythe foregoing region by properly setting the foregoing threshold range.The reason is that the subtraction is executed between pixels located inthe vicinity to each other and having the same color, and even if arelatively large difference happens between the values of both pixelswith the same color adjoining to each other, the difference is not solarge that the temperature white defect occurs, and the existence ofonly one temperature white defect is allowed in the foregoing region asdescribed previously on the basis of a general manufacturing rule of theCCD 402.

[0200] When the control section 409 judges that the temperature whitedefect happens on any one among a set of pixels providing thesubtraction result, the control section 409 further judges whether thesubtraction result is positive or negative. A positive symbol means thatany temperature white defect happens on the pixels in the A field thatis the number to be subtracted. Further, a negative symbol means thatany temperature white defect happens on the pixel in the B field that isthe number of subtracting.

[0201] The reason is that the value of a pixel provided by thetemperature white defect indicates a value sharply exceeding the valueof a normal pixel. For this, provided that an influence by thetemperature white defect is involved in the minuend, the numbersubtracted is enough larger than the subtracter, while oppositely tothis provided that an influence by the temperature white defect isinvolved in the subtracter, the minuend indicates an enough larger valuethan the subtracter.

[0202] The control section 409, once judging, by subtraction between aset of pixels where both fields are existent, that the temperature whitedefect is existent on a pixel in the one field for example, rewrites thevalue of a defective pixel in the one field to a value equal to thevalue of pixels with the same color most adjoining to each otherexistent in the other field. For example, when a result when the valueof R at 3 rd row 1 st column in the B field illustrated in FIG. 18(b) issubtracted from the value of R at 1 st row 1 st column in the A fieldillustrated in FIG. 18(b) for example is a value which is positive andexceeds a threshold range, the value of R of a pixel at 1 st row 1 stcolumn in the A field is rewritten by the value of R at 3 rd row 1 stcolumn in the corresponding B field. In this writing the value of acorresponding defective pixel in the A field stored in the externalSDRAM 419 on the basis of memory addresses of the defective image and acorresponding pixel.

[0203] Accordingly, even if the value of any pixel with the temperaturewhite defect is included in the value of each pixel in the A field andthe B field read directly into the external SDRAM 419, the value of thedefective pixel is corrected as the value of a pixel, and in theexternal SDRAM 419 there are stored the values of pixels in the A fieldand B field not containing the temperature white defect. After thecorrection is finished, the control section 419 erases data in bothframe memories 415, 416, whereby the correction process for thetemperature white defect about the A field and the B field is finished.

[0204] After the correction process for temperature white defect isfinished, as illustrated in FIG. 19c, the color interpolation circuit418 calculates a predicted value D of the value of each pixel in the Cfield being the third field using the values of pixels in the A fieldand in the B field not involving the temperature white defect in theexternal SDRAM 29, and writes in succession the predicted value (D) ofeach pixel in the first frame memory 415.

[0205] As an interpolation value by the color interpolation circuit 418,as well known in the prior art for example, the weighted mean of thevalues of pixels with the same color as that of pixels located around apixel to be interpolated or predicted can be adopted.

[0206] When the predicted value (D) of each pixel in the C field iswritten in the frame memory 415, the control section 409 stores asillustrated in FIG. 23(d) the read value (C) of each pixel in the Cfield outputted from the sampling hold circuit 403 in the external SDRAM419 in succession. Simultaneously, the control section 409 suppliessubsequently the read value (D) of each pixel in the C field to thesubtraction circuit 417.

[0207] The subtraction circuit 417, once receiving the supply of theread value (C) of each pixel in the C field, subtracts the read value(C) of each pixel from a predicted value in the frame memory 415. Thesubtraction processing is executed in succession between each pixel ofthe predicted value D in the read value of each pixel corresponding tothe foregoing pixel in the same fashion in the subtraction processingbetween the A field and the B field. The subtraction result (D-C) iswritten into the second frame memory 416 in succession.

[0208] The predicted value D is considered a value not involving thetemperature white defect because it is a value after the correction.Accordingly, provided the temperature white defect is involved in thesubtraction result (D-C), it is the case where it is involved in the Cfield, and in that situation the subtraction result indicates a negativevalue, and its absolute value exceeds a predetermined threshold. Incontrast, provided the temperature white defect is not involved in the Cfield, the absolute value of the subtraction result (D-C) is not soincreased than the case where the temperature white defect is involvedin the C field.

[0209] From this, the control section 409 once 5he absolute value of thecalculation result (D-C) exceeds the threshold for every read value (C)of a pixel judges that the temperature white defect is involved in thevalue (C) of that pixel as a defective pixel. On the basis of memoryaddresses of the defective pixel c and the pixel (D) corresponding tothe former the value of the defective pixel corresponding to the C fieldstored in the external SDRAM 419 is rewritten by a predicted value (D)of a corresponding pixel.

[0210] With the finishing of the correction about the C field data ofthe values of pixels corresponding to all the three fields (A, B, C)where the temperature white defect is corrected are collected in theexternal SDRAM 419.

[0211] The data of the value of any pixel undergoes at need by thesignal processing circuit 405 a color interpolation processing forimproving the resolution of any image, an aperture emphasizingprocessing for emphasizing the contour of an image, and an RGB-YUVprocessing for conversion of a color space. Thereafter, the data of thevalue of any pixel is transferred again to the external SDRAM 419, andproperly undergoes the JPEG compression processing with the JPEGcompression circuit 405 b, and is then stored in a desired recordingmedium 419′.

[0212] The data of the value of a pixel stored in the external SDRAM 419forms images of 1 frame using the date of the values of pixelscorresponding to all the 3 fields (A, B, C).

[0213] Referring to FIGS. 20 to 28, a view is provided, whichexemplarily illustrates a correction processing in the conditions whereone temperature white defect is existent for each color of R, G, B forevery field (A, B, C) of first to third.

[0214] For convenience, as a concrete example of the value of a pixelhaving no temperature white defect, there will be described a patternexample indicated by “5” for R thereof, “15” for G(Gr, Gb), and “10” forB.

[0215] Referring to FIG. 20 illustrates a case where temperature whitedefect ids existent on blue in the A field being the first field. InFIG. 20, there is illustrated an example of the data 420 of the value ofa pixel in a color disposition in one region illustrated in FIG. 18(a).In the example 420 of the data of the value of a pixel there is foundthe value “30” of a pixel located at fourth row 6 th column. The valueof the pixel is understood to be one concerning blue from the arrangedof pixels in FIG. 18(a).

[0216] In FIG. 20, corresponding to FIGS. 24(b) to FIG. 20(d), there areillustrated arranged tables 30 a, 30 b, and 30-c for the values ofpixels extracted from the data 420 of the values of pixels for everyfield. In the data table 421 in FIG. 20 pixels becoming objects of asubtraction processing by the subtraction circuit 417 concerning thenfirst field (A) and the second field (B) are extracted and listed. Inthe data table 421 a the calculatioresult (A-B) for each pixelcalculated by the subtraction circuit 417 is listed. Each value in thedata table 421 a is a difference between the values of pixels atpositions in the arranged corresponding to those on the arranged table420 a and 420 b. In the data table 421 a they are indicated with “0”excepting one subtractioresult indicating the value of “20”.

[0217] On the other hand, the operation result of value [20] means thatas explained referring to FIG. 19(b), there is a defect of a temperaturewhite defect in a pixel for imparting a number to be subtracted, thatis, pixel value data 420, a B (blue) pixel of A field positioned on line4 row 6 of a data table 421.

[0218] Therefore, a pixel value [30] of the defective pixel is rewrittenby a pixel corresponding to the defective pixel, that is, a pixel value[10] of a B pixel positioned on line 6 row 6 to which is imparted asubtraction number of the operation processing, as shown in Data Table422.

[0219] Further, predication data 422 a which is a prediction value Dwith respect to C field is obtained from each pixel value of A field andB field of Data Table 422 by a color interpolation in a colorinterpolation circuit 418.

[0220] As explained referring to FIG. 19(d), the subtraction circuit 417carries out a subtraction with each value of Arrangement Table 420 cwhich is a measured value of C field as a subtraction number, and witheach value of the predication data 422 a as a number to be subtracted toobtain the subtraction result shown in Data Table 422 b. In thisexample, since all values in Data Table 422 b are [0], which thereforemeans that a temperature white defect is not present in C field. Thisdoes not violate the condition, since the present of a temperature whitedefect has been already found in one B pixel of A field, that thetemperature white defect of CCD 402 is not more than one everypredetermined area.

[0221] Pixel values of Arrangement Table 420 a have been written, whenreading C field, in an area of C field of Data Table 422 in FIG. 20, butsince the temperature white defect is not contained in each value of Cfield, the pixel values in C field are not subjected to correction.

[0222] Accordingly, finally, the pixel values in Data Table 422 notcontaining the temperature white defect are to be stored in externalSDRAM 19.

[0223]FIG. 21 shows the case where there is a temperature white defectin green of A field. In a pixel value data example 130, a pixel value[35] is seen in a Gb pixel on line 4 row 5. Therefore, in Data Table 131a showing the operation result (A-B) of Arrangement Tables 130 a, 130 bis shown a pixel value [20] showing the presence of one temperaturewhile defect. Since this pixel value [20] is positive, it is judged thata temperature while defect is present in a Gb pixel of A field on line 4row 5 to be a number to be subtracted, and it is rewritten by a pixelvalue [15] of a Gb pixel in B field position on line 6 row 5 to which isimparted a subtraction number of the operation processing, and DataTable 132 after correction similar to that previously mentioned isobtain within an external SDRRAM 419.

[0224]FIG. 22 shows the case where a temperature white defect is presentin red of A field. In an example of pixel value data 230, a pixel value[25] is obtained in a R pixel on line 7 row 5. The pixel value of the Rpixel on line 7 row 5 is corrected to [5] by the process similar to thatmentioned previously, and Data Table 232 after corrected is obtained inan external SDRAM 419.

[0225] FIGS. 23 to 25 show a treating example where a temperature whiledefect is present in blue, green and red of B field. In an example ofpixel value data 330 of FIG. 23, a pixel value [30] is seen in a B pixelon line 6 row 4. In this case, in Data Table 331 a showing thesubtraction result (A-B) of Arrangement Tables 330 a, 330 b is shown apixel value [−20] showing the presence of one temperature white defect.Since the pixel value [−20] is negative, it is determined that atemperature white defect is present in a B pixel on line 6 row 4 of Bfield to be a subtraction number, and it is rewritten by a pixel value[10] of a B pixel of A field positioned on line 4 row 4 to whichimparted a number to be subtracted in the operation processing, and aData Table 332 after correction similar to that described above withinan external SDRAM 419 is obtained.

[0226] In an example of pixel value data 480 of FIG. 24, a pixel value[30] is seen in a Gb pixel on line 6 row 3. In Data Table 431 a showingthe subtraction result (A-B) of Arrangement Tables 430 a, 430 b is showna pixel value [−20] showing the presence of one temperature whitedefect.

[0227] Accordingly, the pixel value of the defect pixel is rewritten bya pixel value [15] of a Gb pixel of A field on line 4 row 3 to which anumber to be subtracted is imparted in the subtraction process to obtaina Data Table 432 after correction.

[0228] The pixel value data example of FIG. 25 is an example in which apixel value [25] is seen in a R pixel on line 3 row 6, the pixel valueof the defective pixel is rewritten by a pixel value [5] of a R pixel ofA field on line 1 row 5 to which is imparted a number to be subtractedin the operation processing by the processing similar to that explainedwith reference to FIGS. 23 and 24 to obtain a Data Table 532 aftercorrection.

[0229] FIGS. 26 to 28 show an example in which a temperature whitedefect is present in a pixel of C field which is a third field. In anexample of pixel value data 630 of FIG. 26, a pixel value [30] is seenin a B pixel on line 8 row 4. In this case, values of Data Table 631 ashowing the subtraction result (A-B) of Arrangement Tables 630 a, 630 bare [0] which represents that a temperature white defect is not presentin A field and B field.

[0230] Therefore, values of Data Table 631 formed by extracting A fieldand B field are written in Data Table 632. Further, prediction data 632a which is a prediction value D of C field is obtained from values ofthese A field and B field by a color interpolation circuit 418.

[0231] When the prediction data 632 a is obtained, a subtraction circuit417 carries out an operation processing (D-C) for subtractingcorresponding each value of Arrangement Tale 630 c relative to C fieldfrom each value of the prediction data 632 a. As a result of thissubtraction, Data Table 632 b is obtained. In Data Table 632 b isobtained [0] except one operation result showing a value of [−20]. Theoperation result means that a temperature white defect is not created asdescribed previously.

[0232] On the other hand, in a pixel to which is imparted a subtractionnumber in the operation from which is obtained the operation result[−20], that ism in the example shown in FIG. 26, it is found that adefect of a temperature white defect is present in a B pixel of C fieldpositioned on line 8 row 4 of Data Table 630.

[0233] The pixel value [−20] of the defective pixel is rewritten by aprediction value D to which is imparted a number to be subtracted of theabove-mentioned operation, that is, a value [10] at an arrangementposition of prediction data 632 a corresponding to the arrangingposition of [−20] of Data Table 632 b. As a result, Data Table 632 inwhich a temperature white defect is corrected is obtained.

[0234] In an example of pixel value data 730 of FIG. 27, a pixel value[35] is seen in a Cr pixel on line 6 row 4. In this case, a pixel valueshown by a value [−20] of Data Table 732 b showing the result of theoperation processing (D-C) is rewritten by a value [15] at acorresponding position of Data Table 732 a to obtain Data Table 732 inwhich a temperature white defect is corrected.

[0235] In an example of pixel value data 830 of FIG. 28, a pixel value[25] is seen in a R pixel on line 5 row 5 is seen. In this case, a pixelvalue shown by a value [−20] of Data Table 832 b showing the result ofoperation processing (D-C) is rewritten by a value [5] at acorresponding position of Data Table 732 a to obtain Data Table 832 inwhich a temperature white defect is corrected.

[0236] For simplifying the explanation, FIGS. 20 to 28 showed a patternin which a differential when a temperature white defect is not createdis [0]. Actually, the probability in which a pattern where such adifferential is [0] is present is low, and an unevenness occurs also ina pixel value between pixels of the same color free from a temperaturewhite defect. However, that differential is an extremely small value ascompared with the case of a temperature white defect as described above,and the aforementioned threshold value range is adequately set tothereby enable determination similar to that explained with reference toFUS, 20 to 28.

[0237]FIG. 29 shows a timing chart of a digital still camera accordingto the present invention. According to this digital still camera, asshown in FIG. 33, pixel values of A field, B field and C field obtainedafter the exposure are subjected to operation processing by atemperature white defect correction device 14, whereby the temperaturewhite defect can be corrected adequately and quickly withoutnecessitating a temperature sensor for detecting a temperature whitedefect of CCD 402 or address data for a temperature white defect.Accordingly, a good image of one frame without being affected by atemperature white defect can be formed from the corrected pixel valuesof the three fields within the external SDRAM 419

[0238] As shown in FIG. 15, a normal temperature defect correctiondevice 407 shown by imaginary lines for correcting a black defect or anin-bright white defect not depending upon the temperature of CCD 402 canbe inserted between a sampling signal processing circuit 403 and atemperature white defect correction device 404.

[0239] In this case, since a normal temperature defect not dependingupon the temperature of CCD 402 is corrected by the normal temperaturedefect correction device 407 and a temperature white defect is correctedby a temperature white defect correction device 14, both image defectswhich are dynamic and static in connection with temperatures can becorrected, whereby images of higher quality can be obtained.

[0240] The normal temperature defect correction device 407 can be alsoinserted into the rear stage of the temperature white defect correctiondevice 404, but since the influence of the normal temperature defect canbe eliminated by correction by means of the temperature white defectcorrection device 404, it is desirable that the normal temperaturedefect correction device 407 is inserted into the front stage of thetemperature white defect correction device 404.

[0241]FIG. 30 shows a timing chart where an image is formed using a partof pixel values of all pixels of CCD 402. FIG. 30 shows an example inwhich a digital sill came is operated in a serial mode, showing a recordmode in pixel number one ninth of all pixels of CCD 402. In the serialmode, pixel values of A field and B field are subjected to subtractionprocessing (AB) as explained with reference to FIG. 19(b) and FIG. 19(a)and the pixel values of both the field are subjected to correction of atemperature white defect. An image in the serial mode is formed usingthe pixel value of either one of both the fields in which a temperaturewhite defect is corrected.

[0242] At this time, the above-described operation processing (A-B)between both the fields is carried out every area, and a pixelrepresentative of a temperature white defect of both the fields can becorrected in any field. However, since a pixel value of one field (A orB) which is small in number of temperature white defects is used as aresult of the subtraction processing in the whole area for the purposeof enabling quicker image processing, it is desirable that a temperaturewhite defect in the above one field is corrected, and correction is notcarried out in the other field but the pixel value of the one field inwhich correction is made is used to record an image.

[0243] In the illustration, there is shown an example in which one frameis divided into three fields, but it may be divided into four or morefields as necessary.

[0244] The aforementioned photographing apparatus comprises aphotographing device, an imaging means, a photographing processingportion, and an image processing means.

[0245] The photographing device has a color filter for colordecomposition.

[0246] The photographing device is means for forming an image to bephotographed. The imaging means generally has an imaging optical system(a lens system, an imaging mirror system or, a composite system of alens system and a mirror system or the like), a shutter for passingimaging luminous fluxes through the photographing device or interruptingthe same, and a drive portion for driving opening and closing of theshutter.

[0247] The photographing processing portion caries out the photographingprocessing for forming a charge accumulated and transferred to thephotographing device into a digital signal.

[0248] The image processing means carries out the image processingincluding at least YUV conversion using transfer data transferredthrough the photographing processing portion.

[0249] And, the photographing device is an interlacing transfer system,and in transferring charges of all pixels accumulated, the data transferof charges is carried out dividing it into M (≧3) fields.

[0250] A color filter of the photographing device of the photographingapparatus may be of a primary color system of red (R), green (G) andblue (B), or may be of a complementary color system of yellow (Y), cyan(C), magenta (M) and green (G).

[0251] In an example of the pixel value data 630 of FIG. 26, a pixelvalue [30] is seen in a B pixel on line 8 row 4. In this case, values ofData Table 631 a showing the subtraction results (A-B) of ArrangementTables 630 a, 630 b are [0], indicating that a temperature white defectis not present in A field and B field.

[0252]FIG. 31 is a schematic block diagram showing an “electronic stillcamera (which is normally called a digital camera)” system as anotherexample of the photographing apparatus according to the presentinvention.

[0253] A “photographing device” indicated at reference character 1includes a color filter for color decomposition. For example, thephotographing device is a CCD and the like that utilizes the colorfilter for the color decomposition

[0254] A series of photographing lenses indicated at reference character501, a shutter 502, and a driving section 503 constitute “imaging means”for forming an “image to be photographed” on the photographing device 1.The driving section 503 is controlled by the controller 5 not only todrivingly open and close the shutter 502, but also to drivingly displaceattitude of lenses in the series of photographing lenses in response toan auto-focus (AF) control and a hand-shake correction control.

[0255] A “photographing processor” indicated at reference character 2performs photographing processing for converting electrical chargeswhich are stored in the photographing device 1 to be transferred, intodigital signals. The photographing processor 2 includes a CDS(correlated double sampling circuit) 2 a, an AGC (automatic gain controlcircuit) 2 b, an A/D (analog/digital conversion circuit) 2 c, a TG(timing generation circuit), and the like.

[0256] An “image processor” indicated at reference character 3 includesa CCD-IF (CCD interface) 3 a, a memory controller 3 b, a YUV converter 3c, a compression processor 3 d, and a display I/F (display interface) 3e.

[0257] A “storage section” indicated at reference character 4 is used tostore raw data needed for image processing and data subjected to theimage processing, and includes a RAW-RGB 4 a area for storing the rawdata, a YUV area 4 b, and a JPEG area 4 c. The memory of the storagedevice 4 is volatile.

[0258] In this embodiment, an external storage section 4′ (for example,a memory card) is attachable and detachable to and from a photographingdevice body from the outside. In the external storage section 4′ isstored various images generated through the image processing. Insteadof, or inclusive of providing this attachable and detachable externalstorage section 4′, an image holding area 4″ may be provided inside theimage photographing apparatus in which the above-mentioned variousimages are stored. The memory in the external storage section and theimage holding area is also volatile.

[0259] A “controller (CPU)” indicated at reference character 6 controlstransmission and reception of data between each section of the imageprocessor 3 and the storage section 4 through the memory controller 3 bof the image processor 3. Also, the controller 3 controls the entirephotographing apparatus. A “display section” indicated at referencecharacter 6 is used to display a thumb-nail image, a photographingconfirmation image, and the like. An “operating section” indicated atreference character 7 is used to set a photographing condition, agenerated image condition, or the like.

[0260] Image processing means is provided for performing the imageprocessing including at least “YUV conversion” using transmission data(comprising digital signals) that are transmitted via the photographingprocessor 2. This image processing means is composed of the imageprocessor 3, the storage section 4, and the controller 5.

[0261] It should be noted that the “electronic still camera” as shown inthe system of FIG. 31 includes the embodiment as shown in FIG. 32. FIG.32(a) is a front view; FIG. 32(b) is a side view; and FIG. 32(c) is atop view. Reference character 20 denotes a “camera body”, and referencecharacter 21 an “upper lid” attached to freely open and close by a hinge22 with respect to the camera body 20. FIG. 32 shows a state with theupper lid 21 opened. In the front view, reference character 501corresponds to “a series of photographing lenses” as explained withreference to FIG. 31, reference character 23 to a “strobe”, andreference character 24 to a “finder”.

[0262] In FIG. 32(c), reference character 21A denotes a “liquid crystalmonitor”, and reference character Sw an “upper-lid opening and closingdetection switch”. That is, the upper-lid opening and closing detectionswitch Sw is a switch for detecting whether the upper lid 21 is open orclosed. And reference character DO denotes a “barrier opening knob”.

[0263] A “date switch” indicated at reference character SD is to performsettings of date and time to the electronic still camera. A “framefeeding switch” indicated at reference character SF is a switch forperforming frame feeding of the thumb-nail image displayed on the liquidcrystal monitor 21A, for example. A “storage mode transfer switch”indicated at reference character SM1 is a switch for switching among“recording modes” including a color photographing mode, a monochromephotographing mode, a single-shot mode, a consecutive shot mode, and thelike.

[0264] An “image mode switch” indicated at reference character SM2 is aswitch for performing settings of a photographed image size and thelike. Reference character SP denotes a “display switch” for determiningwhether the display of the image should be performed on the liquidcrystal monitor 21A or not, and reference character SE denotes anexecution switch (enter switch). Reference character SM denotes a “menuswitch”.

[0265] Further, reference character RL denotes a “release switch” forperforming a shutter operation upon photographing. These variousswitches constitute the operating section 7 of FIG. 1.

[0266] In FIG. 31, the photographing device 1 is a photographing devicethat employs an interlacing transfer system in which data transmissionof electric charges is carried out by division thereof into M (≧3)fields when transferring the electric charges of all pixels stored. Asdescribed above, the photographing device 1 includes the “color filterfor color decomposition.” The color filter may belong to theabove-mentioned primary color system, or a complementary color system.

[0267]FIG. 33(a) shows part of a color filter of the primary colorsystem, and FIG. 33(b) shows part of a color filter of the complementarycolor system. In the filter of the primary color system, R designates a“red filter”, G a “green filter”, and B a “blue filter”. These threefilters R, G, and B are two-dimensionally arranged as shown in thefigure. Looking at the arrangement of these filters in the lateraldirection, the R filters and the G filters are alternatively arranged inone line, while the B filters and the G filters are alternativelyarranged in the other line. Accordingly, in the entire color filter, theG filter occupies one half of the entire filter, while each of the R andB filters one fourth thereof.

[0268] In the filter of the complementary color system, Y designates a“yellow filter”, G a “cyan filter”, M a “magenta filter”, and G a “greenfilter”. These four filters Y, C, M, and G are two-dimensionallyarranged as shown in the figure. Looking at the arrangement of thesefilters in the lateral direction, the M filters and the G filters arealternatively arranged in one line, while the Y filters and the Cfilters are alternatively arranged in the other line. Accordingly, inthe entire color filter, each filter occupies one fourth of the entirefilter.

[0269] As described above, as the color filter may be employed not onlythe primary color system but also the complementary color system. Inorder to explain the embodiment more concretely, the case of using theprimary color system will be described hereinafter with reference toFIG. 33(a).

[0270] The photographing device 1 is a photographing device that employsthe interlacing transfer system in which the data transmission of theelectric charges is carried out by division thereof into M (≧3) fieldswhen transferring the electric charges of all pixels stored. Now, thecase M=3 will be first explained below.

[0271]FIG. 34(a), (b), and (c) shows the arrangement of pixels(photoreceptor) in two columns of the photographing device employing theinterlacing transfer system at M=3 in the vertical direction thereof(namely, in the longitudinal direction of the figure). R, Gr, Gb, and Bdesignate filters corresponding to the respective pixels. In thehorizontal direction, namely lateral direction of the figure, pixels ofthe R filters and pixels of the Gr filters are alternatively arranged inone line, while pixels of the B filters and pixels of the Gb filters arealternatively arranged in the other line. The Gr filter is a greenfilter disposed on an arrangement line of the filter R, while the Gbfilter is a green filter disposed on an arrangement line of the filterB.

[0272] For example, in FIG. 34(a), the pixels are arranged to be dividedinto three groups in the longitudinal direction of the figure (namely,in the vertical direction). That is, on the left side of the each pixel,numbers 1, 2, and 3 are repeatedly recorded in the vertical direction.Each number corresponds to one line of the pixel arrangement in thehorizontal direction. Such a line of the pixel arrangement in thehorizontal direction is a “field”. Theses fields are classified by thenumbers disposed on the respective left sides of the pixels, whereby“first field”, “second field”, and “third field” are assigned to therespective fields.

[0273] As shown in FIG. 34(a), the pixel arrangement of thephotographing device in the vertical direction has the first, second andthird fields alternatively arranged repeatedly. Then, the first, secondand third fields that constitute one repeating cycle of the fields arecombined into and hereinafter referred to as a “field group”.

[0274] In FIG. 34, transmission of the electric charges stored in allthe pixels of the photographing device will be carried out as follows.That is, when starting transmission, first an electric charge of thepixel belonging to the first field of each field group is transferred.FIG. 34(a) shows an explanatory diagram of this state. This transmissionwill be hereinafter referred to as “primary transmission (in which theelectric charge of the pixel in the first field of the each field groupis transferred)” for convenience.

[0275] After the primary transmission, next an electric charge of thepixel belonging to the second field of each field group is transferred.FIG. 34(b) shows this state, and this transmission will be hereinafterreferred to as “secondary transmission”. After this secondarytransmission, an electric charge of the pixel belonging to the thirdfield of each field group is transferred. That is, “tertiarytransmission” is conducted (see FIG. 34(c)).

[0276] Accordingly, when the tertiary transmission is completed, thetransmission of all charges is finished. Upon the above-mentionedprimary, secondary, and tertiary transmission, data transmitted with thesame dimension will be hereinafter referred to as the “transmission dataof the same dimension”.

[0277] Now, in cases where the photographing device 1 is a photographingdevice that employs the interlacing transfer system in which the datatransmission of the electric charges is carried out by division thereofinto 3 fields (the first to third fields) when transferring the electriccharges of all pixels stored, the image processing and image generationwill be explained below with reference to a flowchart of FIG. 36.

[0278] In this embodiment, resolution of photographed images can bedivided into three steps “low, medium, and high” as photographingconditions. Further, a thumb-nail image is generated without fail, andwhether the photographing confirmation image should be generated or notis selectively set.

[0279] First, setting of the photographing condition is carried out bythe operation of the operating section 7 of FIG. 1. Little moreconcretely, the upper lid 21A is opened with respect to the electronicstill camera body 21 as shown in FIG. 32, and then the display switch SPis operated to set the liquid crystal monitor 21A to a displayablestate.

[0280] The operation of the menu switch SM causes the liquid crystalmonitor 21A to display a setting screen as shown in FIG. 35, so that therecord setting is performed. In an example of FIG. 35, the AF(auto-focus) is set as the focus control, and for example “1 sec.” isselected from among “Off” and display times “1 sec.” and “3 sec.” fordisplay of the photographed confirmation image on the liquid crystalmonitor 21A Further, for example “medium” is selected from among theresolution of recorded images “high”, “Medium”, and “low”. After thesesettings, the setting contents are confirmed by the execution switch SE.Instead of setting the resolution, image compression rate may be set byuser's selection using the same display system.

[0281] In this state, photographing is carried out. It should be notedthat in a starting state of the flowchart shown in FIG. 36, the electriccharges are stored in all the pixels of the photographing device by thephotographing operation.

[0282] When transmission is started, electric charges data stored in thephotographing device 1 are divided into the three fields according tothe image of interest, so that the primary to tertiary transmission isperformed in sequence. The transferred data are subjected to the“correlated double sampling” by the CDS2 a of the photographingprocessor 2, and then subjected to the automatic gain control by theAGC2 b. Thereafter the data are converted into digital signals (digitaldata) by the A/D2 c to be stored in the storage section 4 via theCCD-I/F Sa and the memory controller Sb of the signal processor 3 (S1).

[0283] At this time, if the controller 5 confirms completion of the datatransmission of the first field (S2), then (“Yes” in the S2) it furtherconfirms whether the display of the photographing confirmation imageshould be set or not (S3). If the setting of the photographing conditionis that as shown in FIG. 5, the photographing confirmation image willhave been displayed for one second.

[0284] At this time, in the state of completing the primarytransmission, each first field of the continued field groups includes Rinformation (information on a red component), G information (informationon a green component), and B information (information on a bluecomponent), as color information. So, after completion of the primarytransmission, the transmission data of the same dimension in the primarytransmission include all information needed for generation of a colorimage and pixels needed for generation of the color image of lowresolution.

[0285] Therefore, at this stage the image processing can be performed.

[0286] In the processing S3, when the display setting of thephotographing confirmation image is confirmed (that is, “Yes” in theS3), image processing of generating the photographing confirmation imageis carried out based on the transmission data of the first fieldtransferred at the same dimension (S4). The photographing confirmationimage thus generated is displayed on the display 6 via the display I/F 3e.

[0287] Subsequently, image processing of generating the thumb-nail imageis performed (S5). It should be noted that if the display setting of thephotographing confirmation image is not confirmed in the processing S3(that is, “No” in the S3), the generation of the photographingconfirmation image is omitted, and the thumb-nail image generatingprocessing may be carried out.

[0288] Next, it is determined or checked whether the resolution of theimage to be generated is set “low” or not (S6). If the “low resolution”is set (that is, “Yes” in the S6), the image processing in compliancewith the transmission data of the first field (the transmission data ofthe same dimension in the primary transmission) is conducted (S7), andthe image of the low resolution is generated.

[0289] If the resolution set is not “low” (that is, “No” in the S6), thecompletion of the data transmission of the second field (namely, thesecondary transmission) is confirmed (S8). Further, it is determined orchecked whether the resolution of the image to be generated is set“medium” (S9).

[0290] If the medium resolution is set (which corresponds to the case ofFIG. 5) (that is, “Yes” in the S9), the image processing of generatingthe medium resolution image is performed utilizing the transmission dataof the first and second fields (namely, the data in the primary andsecondary transmission) (S10).

[0291] If the resolution set is not “medium” in the processing S9 (thatis, “No” in the S9), the completion of the data transmission of thethird field (namely, the tertiary transmission) is confirmed (S11).Thereafter, the image processing of generating the high resolution imageis performed utilizing the transmission data of the first, second, andthird fields (namely, all pixels data) (S12).

[0292] Referring to FIG. 31, the data from the photographing device 1are stored through the photographing processing section or imageprocessing part 2, CCD-I/F 3 a of the signal processing part 3 andmemory controller 3 b in the RAW-RGB section (part) 4 a of the memorysection 4 as an actual data.

[0293] Data of information, R G B stored in the RAW-RGB section 4 a ofthe memory 4 is sent through the memory controller 3 b to the YUVconverting part 3 c corresponding to the setting of user such aspresence or absence of display of the image for confirmingphotographing, resolution, “low”, “middle” and “high” and so on afterdetecting completion of transfer of each field, and is then convertedinto data of YUV signal by means of the YUV conversion and is finallystored in the YUV section 4 b of the memory 4.

[0294] As described above, the image for confirming photographing andthe image of thumbnail made by the transfer data (at the same time asthat of the first transfer) of the first field are displayed through thedisplaying part I/F3 e on the displaying part 6. If the set resolutionis low, the data of YUV signal is again read out through the memorycontroller 3 b from the YUV section 4 b of the memory 4 and is sent tothe compress processing part 3 d. A compress processing is carried outto format of JPEG by the compress processing part 3 d. The compresseddata is then stored in the JPEG section 4 c of the memory 4.

[0295] When the data is stored in the JPEG section 4 c of the memory 4,header data and so on is added to the compressed data of the JPEG asJPEG image data which is stored in the exterior memory 4′ by thecontrolling part 5.

[0296] If there is provided an image storing section 4″, theaforementioned data may be stored in the section 4″.

[0297] If the set resolution is middle, completion of data transfer(second transfer) of the second field is detected and image processingthereof is carried out by use of the transfer data of the first andsecond fields. Similarly, if the set resolution is high, completion ofdata transfer of the third field is detected and image processingthereof is carried out by use of the transfer data (data of all pixels)of the first and third fields.

[0298] As a concrete example, if an photographing device (CCD) havingpixels of 300 ten thousand, horizon: 2048 pixels, perpendicular: 1536pixels, in interlace transferring type of effecting separating transferof three times (first through third transfers), data (transfer data atthe same time) of horizon: 2048 pixels and perpendicular: 512 pixels canbe transferred at one time.

[0299] Accordingly, if a size of horizon: 640 pixels, perpendicular: 480pixels (VGA) is recorded, it is sufficient to make an image with numberof pixels for transfer in the first field. Further, the number of pixelsfor transfer (sum of first and second transfers at the same time) thefirst and second fields become horizon: 2048 pixels and perpendicular:1024 pixels and therefore it is possible to generate an image havingsizes of horizon: 1024 pixels, perpendicular: 768 pixels and horizon:1280 pixels, perpendicular: 1024 pixels.

[0300] If the transfer data of the first field or first and secondfields is used, because aspect ratio between horizontal andperpendicular pixels is different, a horizontally lengthened image isformed.

[0301] However, when converting at the YUV converting part 3 cadjustment of the aspect ratio may be accomplished with processing suchas reading out thinned horizontally from the RAW-RGB section 4 a of thememory 4.

[0302] If an image recording of VGA size similarly as the image ofconfirming photographing or of thumbnail is intended, processing ofphotographed image is sufficient with the transfer data of the firstfield (at the same time as first transfer).

[0303] Therefore, it is possible to accomplish rapidly processing byeffecting the next photographing without effecting processing of datatransfer of the second and third fields.

[0304] Namely, the transfer data of the number of field necessary toeffect image processing corresponding to the set resolution (low, middleand high) is used and the next photographing is started withouteffecting data transfer of unnecessary field to accomplish imageprocessing of high speed.

[0305] It is, also possible to effect image processing in which transferdata of the first to third fields transferred from the photographingdevice 1 are selected, in accordance with the setting ofcompressibility, as the aforementioned selection.

[0306] For example, when hoping to rapidly record and rapidly send,there are many cares of selecting high compressibility.

[0307] So, if the high compressibility is set, image processing iscarried out by use of transfer data of the first field. It is selectedthat transfer data of the first and second fields in the middlecompressibility and of the first to third fields in the lowcompressibility are used respectively.

[0308] Although the fact that the numbers M of division of element(number of fields composing of one field set) are 3 is explained asdescribed above, hereafter, it is considered that transfer time of allthe number of pixels is increased with increase of number of pixel ofthe photographing device.

[0309] In this case, if an image of VGA size is obtained from thetransferred number (homogeneous transfer data of the first transfer) ofpixel of one field which is divided, it is possible to effect thesimilar image processing as the above even in case of odd number inwhich M are more than 3 as in case of effecting data transfer bydividing into 5 (five) fields.

[0310] Hereinafter, an explanation about a case that divided numbers offields in the photographing device 1 of interlace transferring type are4 (four) will be made in connection with FIG. 41.

[0311] FIGS. 37(a), (b) and (c) illustrate an arrangement of pixels(light receiving element) of 2 rows in a perpendicular direction of thephotographing device of interlace transferring type of M=4, inaccordance with FIG. 34. In order to avoid complication, the samereference numerals as in FIG. 4 are attached to what about which it isconsidered that there is no fear of confusion. Accordingly, the membersin which the same reference numerals as in FIG. 34 attached are the sameas that in FIG. 34.

[0312] In certain row, pixels of filters R and Gr are alternatelyarranged, in the other row, pixels of the filters B and Gb arealternately arranged, horizontally (right and left direction) as viewedin FIG. 37.

[0313] For example, in FIG. 37(a), arrangement of pixels in up and downdirections (perpendicular direction) is separated in 4 (for) groupsrespectively. Namely, numerals of 1, 2, 3 and 4 are repeatedly attachedin the left side of arrangement of perpendicular pixels, each of thesenumerals shows field.

[0314] In FIG. 37, the first, second, third and fourth fields constituteone group of field.

[0315] In FIG. 34, the transfer of electrification accumulated in allthe pixels in the photographing device will be carried out as follows.

[0316] As the transfer is stated, transfer of electrification of pixelsbelong to the first field in each field group is carried out (firsttransfer, see FIG. 37(a)), after completion of the first transfer,transfer of electrification of pixels belong to the second field in eachfield group is carried out (second transfer, see FIG. 37(b)).

[0317] When the second transfer is completed, transfer ofelectrification of pixels belong to the group is carried out (thirdtransfer, see FIG. 37(c)), finally, transfer of electrification ofpixels belong to the fourth field in each field group is carried out(fourth transfer, see FIG. 37(d)).

[0318] At the time of completion of the fourth transfer, the transferfor all the electrifications is completed.

[0319] Preparation of image and image processing using the photographingdevice will be explained in reference be explained in reference with ablow as shown in FIG. 42.

[0320] In the embodiment, it is possible setting resolution of thephotographed image in three steps of low, middle and high as conditionof photographing and setting selectively presence and absence ofconfirming photographing by making necessarily the thumbnail image.

[0321] Setting of condition of photographing is effected, lent thesetting is similar as the case of M=3, a state of setting is as shown inFIG. 35, for example.

[0322] In this state, photographing is effected. In the state of “start”in the flow in FIG. 38, electrification is accumulated in all the pixelsof the photographing device by photographing.

[0323] As the transfer is started, the data of electrificationaccumulated in the photographing device 1 corresponding element to animage of an object to be photographed are divided into four (4) fieldsto effect the first to fourth transfers in turn. The data to betransferred is adapted to make correlating double sampling by the CDS2 ain the im age processing part 2 shown in FIG. 35 and then isautomatically controlled by the AGC2 b and is converted into digitalsignal by the A/D 2 c and the then is stored through the CCD-I/F 3 a andmemory controller 3 b of the signal processing part 3 in the memory4(S21).

[0324] At that time, the controlling part 5 confirms the completion ofdata transfer of the first and second fields (S21). At that time (Yes inS22), presence and absence of setting for display of the image forconfirming photographing are confirmed (823). If the setting ofcondition for photographing is as shown in FIG. 5, the image forconfirming photographing is displayed for one second.

[0325] Here, gathering from the state that the first transfer iscompleted, the first field includes only information R (red component)and G (green component) and does not include information B (bluecomponent) as color information.

[0326] Therefore, when the first transfer is completed, informationnecessary to make color image is not totally included in thehomogeneously transferred data.

[0327] However, when the second transfer is completed, the datahomogeneously transferred in the first transfer and the datahomogeneously transferred in the second transfer include all theinformation R (red component), G (green component) and B (bluecomponent) as color information. Accordingly, when the second transferis completed, the transferred date include all the information necessaryto make the color image and also include pixels necessary to make thecolor image having lour resolution.

[0328] Consequently, it is possible to effect image processing in thisstep.

[0329] In the processing S23, when the setting for displaying image ofconfirming photographing is confirmed (Yes in S2), the image processingof making the image of confirming photographing is carried out based onthe transfer data of the first and second fields (S24). The formed imageof confirming photographing is displayed through the display I/F3 e onthe displaying part 6.

[0330] Subsequently, the image processing of making the thumbnail imageis carried out (S25). In the processing S23, if it is not the settingfor displaying the image for confirming photographing (No in S23), theimage processing of making the thumbnail image is carried out withomitting preparation of image for confirming photographing.

[0331] Next, confirmation about whether or not resolution of imageformed is set in low is effected (S26), if the low resolution is set (Noin S26), the image processing is carried out (S27) the transfer data ofthe first and second fields (sum of homogenous transfer data by thefirst and second transfers) to prepare an image having the lowresolution is not low (Yes in S26), the completion of data transfer(third and fourth transfers) of the third and fourth fields is confirmed(S28), when the completion is confirmed (Yes in S28), image processingis carried out by use of the transfer data (data of third and fourthtransfers) of the third and fourth fields.

[0332] If the set resolution is middle and high, image processing iscarried out by use of transfer data after the fourth transfer. When inimage of high resolution is prepared, image processing is carried out byuse of all the data of pixels after the fourth transfer, if an image ofmiddle resolution is prepared, third of data from all the data iseffected to obtain data of necessary number of pixels, thus effectingimage processing based on the obtained data (S29).

[0333] Referring to FIG. 31, the transfer data from the photographingdevice 1 are sent in the order of first, second, third image processingpart 2, CCD-I/F3 a of the signal processing part 3 and memory controller3 b to the RAW-RGB section 4 a of the memory 4 as actual data and storedtherein.

[0334] The data of information R-G-B stored in the RAW-RGB section 4 aof the memory 4 are sent through the memory controller 3 b to the YUVconverting part 3 c in accordance with the setting of a user which isreferred to as presence and absence of display of the image forconfirming photographing, resolution, low, middle and high afterdetection for completion of transfer of each field and are convertedinto data of YUV signal by means of the YUV conversion and there arestored in the YUV section 4 b of the memory 4.

[0335] As described above, the image of confirming photographing andthumbnail image prepared by the transfer data (each homogeneous transferdata in the first and second transfers) of the first and second fieldsare displayed through the displaying part I/F 3 e on the displaying part6.

[0336] If the set resolution is also low, the data of YUV signal areagain read out though the memory controller 3 b from the YUV section 4 bof the memory 4 and it is sent to the compress processing part 3 d.Compress processing to the JPEG format is carried by means of thecompress processing part 3 d and then the compressed data are stored inthe JPEG section 4 c of the memory 4.

[0337] When the data are stored in the JPEG section 4 c of the memory 4,header data and so on are attached to the compressed data of JPEG and asJPEG image data, the data are stored in the exterior memory 4′ by meansof control of the controlling part 5. If there is provided the section4′ for storing image, the data may be stored in the section 4″.

[0338] If the set resolution is middle, high, completion of datatransfer (third, fourth transfers) is detected and the image processingis carried out by use-of the transfer data of the first to fourthfields.

[0339] As an embodied example, if an photographing device of pixels of300 ten thousand having horizon: 2048 pixels, perpendicular: 1636 pixelsis used, in an interface transferring type of effecting separatedtransfers of 4 (four) times (first to fourth transfers), data(homogeneous transfer data) horizon: 2048 pixels, perpendicular, 384pixels are transferred at one time.

[0340] Accordingly, if the size of horizon: 640 pixels, perpendicular:480 pixels (VGA) is recorded, it is sufficient to make an image withmember of transferred pixels (horizon: 2048 pixels, perpendicular: 768pixels) of the first and second fields and therefore an image of size ofhorizon: 1024 pixels, perpendicular: 768 pixels (XGA) can be generated.

[0341] If the transfer data of the first and second fields are used,because aspect ratio between horizontal pixels and perpendicular pixelsis different, a horizontally lengthened image is formed.

[0342] However, when converting at the YUV converting part 3 c,adjustment of the aspect ratio may be accomplished with processing suchas reading out thinned horizontally from the RAW-RGB section 4 a of thememory 4.

[0343] If image recording of VGA size similarly as the image ofconfirming photographing or of thumbnail is intended, processing ofphotographed image is sufficient with the transfer data of the first andsecond fields.

[0344] Therefore, it is possible to accomplish rapid processing byeffecting the next photographing without effecting processing of datatransfer of the third and fourth fields.

[0345] Namely, the transfer data of the number of field necessary toeffect image processing corresponding to the set resolution (low, middleand high) is used and the next photographing is started withouteffecting data transfer of unnecessary field to accomplish imageprocessing of high-speed.

[0346] It is, also possible to effect image processing in which transferdata of the first to fourth fields transferred from the photographingdevice 1 are selected, in accordance with the setting ofcompressibility, as the aforementioned selection.

[0347] For example, when hoping to rapidly record and rapidly send,there are many cares of selecting high compressibility.

[0348] So, it can be selected that if the high compressibility is set,image processing is carried out by use of transfer data of the first andsecond fields, transfer data of the first to fourth fields in the middleor low compressibility are used respectively.

[0349] In the above, the separated number M (number of fields consistingone field group) of the fields in the photographing device are 4, buthereafter it is considered that transfer time of all the number ofpixels is increased with increase of number of pixel of thephotographing device.

[0350] In this case, if M is even number more than 4, for example, M=6and data are transferred by dividing into 6 fields and images ofconfirming photographing and of thumbnail and recorded image of lowresolution and high compressibility are prepared, it is possible to makethe image(s) by use of the transfer data obtained by transfer of thefirst and second fields.

[0351] If a recorded image of middle resolution and middlecompressibility is prepared, it is possible to make the image by use ofthe transfer data obtained by transfer of the first to fourth fields. Ifa recorded image of high resolution and high compressibility is alsoprepared, it is possible to make the image by use of the transfer dataobtained by transfer of the first to sixth field.

[0352] In the embodiment explained in connection with FIGS. 31 to 37,electrification of all the pixels accumulated corresponding to an imagefocused on the photographing device 1 having a color filter fordissolving colors by imaging means is transferred. In this case, thedata transfer of electrification is carried out by dividing into M (≧3)fields.

[0353] An photographing method for carrying out image processingincluding at least YUV conversion by use of the transfer data of m (<M)field in which all the color signals and necessary pixels are get isembodied.

[0354] In the embodiment shown in FIGS. 34 and 36, number of fields: Mis odd number of 3 or more, m=1. In the embodiment shown in FIGS. 37 and38, number of fields: M is even number of 4 or more, m=2.

[0355] Also, in the above embodiments, when the transfer data of m fieldis get, image processing including at least YUV conversion isimmediately carried out.

[0356] An image for confirming photographing and a thumbnail image aremade by image processing including YUV conversion.

[0357] In the above embodiments, condition of an image to be formed isset and image processing is carried out by use of transfer data of n(m≦n≦M) field to make said image to be formed.

[0358] Condition of an image to be formed is resolution of image and nis number of field in which number of pixel necessary to make an imageof the set resolution is get.

[0359] In the embodiment shown in FIGS. 34, 35 and 36, M=3, an image oflow resolution is prepared with respect to number of field: n=1, animage of middle resolution is prepared with respect to number of field:n=2, and an image of high resolution is prepared with respect to numberof field: n=M.

[0360] In the embodiment shown in FIGS. 35, 37 and 38, M=4, an image oflow resolution is prepared with respect to n=2, images of middle and/orhigh resolutions are prepared with respect to number of field: n=M.

[0361] As described above, in each embodiment, as condition of an imageto be made, compressibility of image is used, n is number of fields inwhich number of pixels necessary to make an image of the setcompressibility are get, in the embodiment shown in FIGS. 35, 37 and 38,processing of compressing the image is carried out on format of JPEGwith respect to M=3, number of field: n=1.

[0362] In the embodiment shown in FIGS. 35, 37 and 38, M=4 or 6,processing of compressing the image is carried out on format of JPEGwith respect to number of field: n=2.

[0363] An photographing apparatus as shown in FIG. 31 comprises: anphotographing device 1 having a color filter for resolving color:imaging means 501, 502 and 503 for focusing an image to be photographedon said photographing device; an imaging processing part 2 forconverting to digital signal electrification stored in saidphotographing device and transferred; and means 3, 4 and 5 for carryingout image processing including at least YUV conversion by use oftransfer data transferred through said imaging processing part. Thephotographing device is interlace transferring type and divides datatransfer of electrification of stored all pixels into M(≧3) fields.

[0364] The color filter of the photographing device is composed oforiginal colors of red (R), green (G) and blue (B).

[0365] The color filter of the photographing device is composed ofcomplementary color of yellow (Y), cyan (C), magenta (M) and green (G).

[0366] In the photographing apparatus shown in FIGS. 31 to 34, 35 and36, M is 3 in the photographing device of interlace transferring typeand M is 4 or 6 in the photographing device of interlace transferringtype.

[0367] The photographing apparatus has a displaying part 6 fordisplaying an image for confirming pick up and/or an image of thumbnailand a removable exterior memory 4′ for storing the formed image.

[0368] The apparatus has an image holding section 4″ for storing theformed image.

[0369] The aforementioned electronic still camera is one example of theimage information processing apparatus having at least one portion ofthe photographing apparatus.

[0370] For example, when displaying the image of confirmingphotographing, if the image processing is carried out after the data ofall the pixels in the photographing device are transferred, it take timeof 0.3 seconds in conventional pixels of 300 ten thousand until theimage is displayed.

[0371] If M=3, m=1, with time of 0.1 seconds, if M=4, m=2, with time of0.15 seconds, it is possible to display the image to be easy to use theapparatus.

[0372] As described above, according to the present invention, when theelectrification accumulated in the photographing device is transferred,since image data can be prepared without awaiting transfer of data ofall pixels, it is possible to eliminate time for confirming thephotographed image or until the next photographing.

What is claimed is:
 1. A photographing apparatus of interlacetransferring type comprising: a photographing device which carries outtransfer of electrification of all pixels stored in the photographingdevice by dividing into a plurality of fields when transferring theelectrification and which has a plurality of color filters and whichincludes a color signal of at least RGB or YeCyMgG in said transfer dataof each field for transferring said electrification; extraction meansfor extracting characteristic data of image from transferred data beforeprocessing for image is started; generating means for generating controlvalue carrying out correction of image based on said extractedcharacteristic data; and image processing means for processing image byuse of control value formed by said characteristic data.
 2. Aphotographing apparatus of interlace transferring type comprising: aphotographing device which carries out transfer of electrification ofall pixels stored in the photographing device by dividing into aplurality of fields when transferring the electrification and which hasa plurality of color filters and which includes a color signal of atleast RGB or YeCyMgG in said transfer data of each field fortransferring said electrification; extraction means for extractingcharacteristic data of image from transferred data before processing forimage is started; generating means for generating control value carryingout correction of image based on said extracted characteristic data;image processing means for processing image by use of control valueformed by said characteristic data; and selection means for selectingeither a first mode for processing and recording the transfer data ofall pixels accumulated in said photographing device or a second mode forprocessing and recording transfer data of pixels less than said allpixels, wherein in said second mode selected by said selection means,later transferred data is processed and recorded by the control valuegenerated by said characteristic data extracted from the previouslytransferred data with division of the plurality of fields.
 3. Aphotographing apparatus of interlace transferring type according toclaim 1 or 2, wherein said color filter provided in said photographingdevice is composed of original color of RGB.
 4. A photographingapparatus of interlace transferring type according to claim 1 or 2,wherein said color filter provided in said photographing device iscomposed of complementary color of YeCyMgG.
 5. A photographing apparatusof interlace transferring type according to any one of claims 1 to 4,wherein said apparatus has an interlace transfer in which transfers of 3times carried out by dividing the plurality of fields are achieved andeach field is thinned perpendicularly into ⅓.
 6. A photographingapparatus of interlace transferring type according to any one of claims1 to 5, wherein said characteristic data of image is color distributionfor control of white balance and control value for white balance isgenerated based on said characteristic.
 7. A photographing apparatus ofinterlace transferring type according to any one of claims 1 to 5,wherein said characteristic data of image is data in which edgecomponent within a screen is extracted and a control value for enhancingthe edge is generated based on said characteristic data.
 8. Aphotographing apparatus of interlace transferring type according to anyone of claims 1 to 5, wherein said characteristic data of image is datain which a color information within a screen is extracted and a controlvalue of color converting coefficient is generated based on saidcharacteristic data.
 9. A photographing apparatus of interlacetransferring type according to any one of claims 1 to 5, wherein saidcharacteristic data of image is data in which distribution of brightnesswithin a screen is extracted and a control value of contrast correctionis generated based on said characteristic data.
 10. A photographingapparatus of interlace transferring type according to any one of claims1 to 5, wherein said photographing apparatus generates processes imageof digitalization and said characteristic data of image is data in whichdistribution of brightness within a screen is extracted and threshold ofdigitalized processing based on said characteristic data is generated asa control value.
 11. A photographing method of interlace transferringtype comprising the steps of: dividing data transfer of electrificationof all pixels stored in an photographing device of interlacetransferring type into a plurality of fields when transferring theelectrification; providing a plurality of color filters in saidphotographing device; receiving transfer data from said image elementwhich transfers data including a color signal of at least RGB or YeCyMgGto each field; extracting characteristic data of image from thetransferred data; and generating a control value of effecting correctionof image based on the extracted characteristic data to make imageprocessing using said control value.
 12. A photographing method ofinterlace transferring type comprising the steps of: dividing datatransfer of electrification of all pixels stored in an photographingdevice of interlace transferring type into a plurality of fields whentransferring the electrification; providing a plurality of color filtersin said photographing device; receiving transfer data from said imageelement which transfers data including a color signal of at least RGB orYeCyMgG to each field; extracting characteristic data of image from thetransferred data; generating a control value of effecting correction ofimage based on the extracted characteristic data to make imageprocessing using said control value; and processing and recording latertransferred data by the control value generated by said characteristicdata extracted from the previously transferred data with the division inthe plurality of fields.
 13. A photographing method of interlacetransferring type according to claim 11 or 12, wherein achieving 3 timesof transfers of electrification carried out by dividing into theplurality of fields and thinning perpendicularly each field into ⅓. 14.A photographing apparatus including a solid photographing device whichhas a plurality of pixels compartmentalized in every predeterminedregions and in which a pixel for detecting a pixel value of each colorof three original colors through a color filter of said plurality ofpixels is arranged in said regions, said photographing device beingdetermined so that a defecting pixel for generating a white scratch oftemperature which changes according to temperature is one or less ineach region, each pixel value of all the pixels in the solidphotographing device being read out with division of fields of three ormore to form an image of one frame based on the read out pixel value,comprising: means for obtaining a difference about the pixel value amongthe pixels at arranged positions corresponding to first and secondfields detected through color filters of the mutually same colorarrangement every said regions; and means for judging that when adifference between two pixels exceed a predetermined threshold, onepixel of the two is the defecting pixel and for amending a pixel valueof the one pixel based on a pixel value of the other pixel of the two.15. A photographing apparatus according to claim 14, wherein the pixelvalue of said one pixel is rewritten by the pixel value of the otherpixel.
 16. A photographing apparatus according to claim 14, wherein saidapparatus further comprises means for obtaining a difference between apredicated value predicated by a pixel value of each pixel of a thirdfield from each pixel of the first and second fields and a pixel valueobtained from each pixel of the third field, and means for judging thatwhen the difference obtained by the said means for obtaining thedifference exceeds said predetermined threshold, the pixel of the thirdfield is said defective pixel and for rewriting the pixel value of thedefective pixel by said predicated value.
 17. A photographing apparatusaccording to claim 14, wherein when a photographing mode of indicatingelimination of the number of pixels is selected, a field having a lessdefective pixel is selected about all three original colors, and animage of one frame is formed from a pixel value of pixel of the field.18. A photographing apparatus according to claim 17, wherein saidphotographing mode is a continuous taking-out mode.
 19. A photographingapparatus according to claim 14, wherein a correcting device for defectof ordinary temperature is provided at prior to said correcting devicefor white defect of temperature, said correcting device for defect ofordinary temperature amending a defect of ordinary temperature whichdoes not depend on temperature of said pixel previously to effectamendment of the pixel value of the defective pixel by said correctingdevice for white defect.
 20. A photographing method comprising the stepsof: preparing a solid photographing device which has a plurality ofpixels compartmentalized in every predetermined regions and in which apixel for detecting a pixel value of each color of three original colorsthrough a color filter of said plurality of pixels is arranged in saidregions, said photographing device being determined so that a defectingpixel for generating a white scratch of temperature which changesaccording to temperature is one or less in each region, each pixel valueof all the pixels in the solid photographing device being read out withdivision of fields of three or more to form an image of one frame basedon the read out pixel value; obtaining a difference about the pixelvalue among the pixels at arranged positions corresponding to first andsecond fields detected through color filters of the mutually same colorarrangement every said regions; and judging that when a differencebetween two pixels exceed a predetermined threshold, one pixel of thetwo is the defecting pixel and for amending a pixel value of the onepixel based on a pixel value of the other pixel of the two.
 21. Aphotographing method comprising the steps of: dividing data transfer ofelectrification of all pixels stored corresponding to an image focusedon an photographing device having a color filter for resolving color bymeans of a focused means into M(≧3) fields; and carrying out imageprocessing including at least YUV conversion by use of transfer data ofm (<M) fields in which all color signals and necessary number of pixelare get.
 22. A photographing method according to claim 21, whereinnumber of fields: M is odd number of 3 or more, m=1.
 23. A photographingmethod according to claim 21, wherein number of fields; M is even numberof 4 or more, m=2.
 24. A photographing method according to claim 21 or22 or 23, wherein when the transfer data of m field is get, imageprocessing including at least YUV conversion is immediately carried out.25. A photographing method according to any one of claims 21 to 23,wherein an image for confirming photographing is made by imageprocessing including YUV conversion.
 26. A photographing methodaccording to any one of claims 21 to 25, wherein thumbnail image is madeby image processing including YUV conversion.
 27. A photographing methodaccording to any one of claims 21 to 26, wherein condition of an imageto be formed is set and image processing is carried out by use oftransfer data of n (m≦n≦M) field to make said image to be formed.
 28. Aphotographing method according to claim 27, wherein condition of animage to be formed is resolution of image and n is number of field inwhich number of pixel necessary to make an image of the set resolutionis get.
 29. A photographing method according to claim 28, wherein M=3,an image of low resolution is prepared with respect to number of field:n=1, an image of middle resolution is prepared with respect to number offield: n=2, and an image of high resolution is prepared with respect tonumber of field: n=M.
 30. A photographing method according to claim 28,wherein M=4, an image of low resolution is prepared with respect to n=2,images of middle and/or high resolutions are prepared with respect tonumber of field: n=M.
 31. A photographing method according to claim 28,wherein M=6, an image of high resolution is prepared with respect ton=M, an image of low resolution is prepared with respect to number offield: n=2 or an image of middle resolution or low resolution isprepared with respect to number of field; n=4.
 32. A photographingmethod according to claim 27, wherein condition of an image to be formedis compressibility of image, and n is number of field in which number ofpixel necessary to make the image of the set compressibility is get. 33.A photographing method according to claim 32, wherein M=3, processing ofcompressing the image is carried out on format of JPEG with respect tonumber of field: n=1.
 34. A photographing method according to claim 32,wherein M=4 or 6, processing of compressing the image is carried out onformat of JPEG with respect to number of field: n=2.
 35. A photographingapparatus comprising: a photographing device having a color filter forresolving color: imaging means for focusing an image to be photographedon said photographing device; a photographing processing section forconverting to digital signal electrification stored in saidphotographing device and transferred; and means for carrying out imageprocessing including at least YUV conversion by use of transfer datatransferred through said imaging processing part, wherein saidphotographing device is interlace transferring type and divides datatransfer of electrification of stored all pixels into M(≧3) fields. 36.A photographing apparatus according to claim 35, wherein said colorfilter of the photographing device is composed of original colors of red(R), green (G) and blue (B).
 37. A photographing apparatus according toclaim 35, wherein said color filter of the photographing device iscomposed of complementary color of yellow (Y), cyan (C), magenta (M) andgreen (G).
 38. A photographing apparatus according to claim. 35, 36 or37, wherein M is 3 in the photographing device of interlace transferringtype, and said apparatus embodies said photographing method as recitedin claim 29 or
 34. 39. A photographing apparatus according to claim 35,36 or 37, wherein M is 4 or 6 in the photographing device of interlacetransferring type, and said apparatus embodies said photographing methodas recited in claim 30, 31 or
 34. 40. A photographing apparatusaccording to any one of claims 35 to 39, wherein said apparatus embodiessaid photographing method as recited in claim 25 or 26 and has adisplaying part for displaying an image for confirming pick up and/or animage of thumbnail.
 41. A photographing apparatus according to any oneof claims 35 to 40, wherein said apparatus has a removable exteriormemory for storing the formed image.
 42. A photographing apparatusaccording to any one of claims 35 to 41, wherein said apparatus has animage holding section for storing the formed image.
 43. An informationprocessing apparatus of image comprising said photographing apparatus asrecited in claims 35 to 41 as at least one portion.